Resources

Research Papers

Foundational Papers

ReAct: Synergizing Reasoning and Acting in Language Models

• Authors: Yao et al. (2022)
• Paper
• Key contribution: Reasoning + Acting pattern

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

• Authors: Wei et al. (2022)
• Paper
• Key contribution: Step-by-step reasoning

Toolformer: Language Models Can Teach Themselves to Use Tools

• Authors: Schick et al. (2023)
• Paper
• Key contribution: Self-taught tool use

Generative Agents: Interactive Simulacra of Human Behavior

• Authors: Park et al. (2023)
• Paper
• Key contribution: Memory and planning

Recent Advances

GPT-4 Technical Report

• OpenAI (2023)
• Paper

Constitutional AI: Harmlessness from AI Feedback

• Anthropic (2022)
• Paper

Tree of Thoughts: Deliberate Problem Solving with Large Language Models

• Yao et al. (2023)
• Paper

Books

Artificial Intelligence: A Modern Approach

• Authors: Russell & Norvig
• Classic AI textbook
• Agent architectures

Deep Learning

• Authors: Goodfellow, Bengio, Courville
• Neural network foundations
• Free online

Reinforcement Learning: An Introduction

• Authors: Sutton & Barto
• RL fundamentals
• Free online

Online Courses

DeepLearning.AI

• LangChain courses
• AI agent specializations
• Website

Fast.ai

• Practical deep learning
• Free courses
• Website

Stanford CS224N

• NLP with Deep Learning
• Course page

Blogs & Tutorials

Lilian Weng’s Blog

• lilianweng.github.io
• Excellent agent overviews
• Research summaries

Anthropic Research

• anthropic.com/research
• Constitutional AI
• Safety research

OpenAI Blog

• openai.com/blog
• Model releases
• Research updates

Hugging Face Blog

• huggingface.co/blog
• Model tutorials
• Community projects

Communities

Discord Servers

• LangChain Discord
• OpenAI Developer Community
• AI Agent Builders

Reddit

• r/MachineLearning
• r/LanguageTechnology
• r/artificial

GitHub

• Awesome-LLM repositories
• Agent implementations
• Open source projects

Conferences

NeurIPS - Neural Information Processing Systems

• December annually
• Top ML conference

ICML - International Conference on Machine Learning

• July annually
• Core ML research

ICLR - International Conference on Learning Representations

• May annually
• Deep learning focus

ACL - Association for Computational Linguistics

• July annually
• NLP research

Datasets & Benchmarks

HumanEval

• Code generation benchmark
• GitHub

MMLU - Massive Multitask Language Understanding

• Knowledge benchmark
• 57 subjects

BIG-bench

• Diverse task benchmark
• GitHub

AgentBench

• Agent capability benchmark
• Multi-environment testing

Tools & Platforms

Weights & Biases

• Experiment tracking
• wandb.ai

LangSmith

• LangChain debugging
• Trace visualization

Helicone

• LLM observability
• Cost tracking

PromptLayer

• Prompt management
• Version control

Code Repositories

LangChain

• github.com/langchain-ai/langchain

AutoGPT

• github.com/Significant-Gravitas/AutoGPT

BabyAGI

• github.com/yoheinakajima/babyagi

AgentGPT

• github.com/reworkd/AgentGPT

Stay Updated

Newsletters

• The Batch (DeepLearning.AI)
• Import AI
• TLDR AI

Twitter/X Accounts

• @AndrewYNg
• @karpathy
• @ylecun
• @goodfellow_ian

YouTube Channels

• Andrej Karpathy
• Two Minute Papers
• Yannic Kilcher

Practice Platforms

Kaggle

• Competitions
• Datasets
• Notebooks

HuggingFace Spaces

• Deploy demos
• Share models

Replicate

• Run models
• API access