Episode

Evaluating AI Abilities

Podcast
Data Skeptic
Published
May 27, 2024
Duration seconds
2980
Processing state
failed
Canonical source
https://dataskeptic.com/blog/episodes/2024/evaluating-ai-abilities
Audio
https://pscrb.fm/rss/p/mgln.ai/e/35/traffic.libsyn.com/secure/dataskeptic/evaluating-ai-abilities.mp3?dest-id=201630
JSON
/v1/public/podcasts/data-skeptic/episodes/evaluating-ai-abilities
Markdown
/podcast/data-skeptic/evaluating-ai-abilities.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/data-skeptic/episodes/evaluating-ai-abilities/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/data-skeptic/evaluating-ai-abilities.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

In this episode, Kozzy discusses his endeavors to compare the cognitive abilities of humans, animals, and AI programs. Specifically, we discussed object permanence, the ability to understand an object still exists in space even when you can't see it. Our conversation traverses both philosophical and practical questions surrounding AI evaluation. We also learned about Animal AI 3, a gaming environment developed in Unity where AI programs and humans can go head-to-head to solve different problems in a gaming environment.