Skip to main content

CS50: Week 6.5 - Artificial Intelligence

Welcome!​

  • In computer science and programming circles, rubber ducking or rubber duck debugging is the act of speaking to an inanimate object to be able to talk through a challenging problem.
  • Most recently, CS50 created our own rubber duck debugger at cs50.ai, which uses artificial intelligence as a way by which to interact with students to help them with their own challenging problems.
  • Students engaging with this tool can begin understanding the potential of what AI can offer the world.

Keyword​

Artificial Intelligence and Machine Learning

  • Artificial Intelligence (AI): The simulation of human intelligence in machines.
  • Machine Learning (ML): A subset of AI that allows systems to learn and improve from experience without being explicitly programmed.  
  • Deep Learning: A subset of ML that uses artificial neural networks to learn complex patterns.
  • Neural Networks: Computational models inspired by the human brain.
  • Large Language Models (LLMs): AI models trained on massive amounts of text data to generate human-like text.
  • Transformer Architecture: A neural network architecture used in LLMs for processing sequential data.
  • Hallucinations: Incorrect or nonsensical outputs generated by AI models.

AI Techniques

  • Decision Trees: A tree-like model of decisions and their possible consequences.
  • Minimax: A decision-making algorithm used in game theory.
  • Reinforcement Learning: A machine learning method where an agent learns to make decisions by interacting with an environment.
  • Explore vs. Exploit: A dilemma in reinforcement learning where an agent must choose between trying new actions (explore) or sticking with known good actions (exploit).

AI and Human Interaction

  • Prompt Engineering: The art of crafting effective prompts to interact with AI models.
  • System Prompt: Initial instructions or guidelines provided to an AI model.
  • User Prompt: Specific input or query given to an AI model.
  • Generative AI: AI capable of creating new content, such as text, images, or code.

Image Generation​

  • Numerous AI tools have created the potential for artificially generated images to enter the world.
  • Up until recently, most of these tools had numerous tells that might indicate to an observer that an image is AI-generated.
  • However, tools are becoming exceedingly good at generating these images.
  • Indeed, as technology improves, it will soon be almost, if not entirely, impossible for such images to be detected with the naked eye.
  • Software has also gained the ability to mutate individual images within video.

ChatGPT​

  • A very well-known bleeding-edge tool is the text generation tool chatGPT.
  • In CS50, we do not allow the use of ChatGPT. However, we do allow the use of our own rubber duck debugger at cs50.ai.
  • In CS50, we leverage the tools of Azure and OpenAI, along with our own vector database that holds very recent information from our most recent lectures and offerings, to provide our rubber duck debugger toll.

Prompt Generation​

  • Prompt generation is the way by which an individual can communicate with an AI platform.
  • We use a system prompt to teach the AI how to interact with users. We teach the AI how to work with students.
  • User prompts are those provided by users to interact with the AI. With these prompts, students interact with the AI.

CS50.ai​

  • Our rubber duck debugger can provide conceptual help with computer science concepts.
  • Further, the rubber duck debugger can help students write more efficient code.
  • Additionally, the rubber duck debugger can help when a student is stuck in one of their assignments. For example, students may encounter errors that prevent them from progressing in their assignments. When students hit a wall, they don’t have to wait for support staff to be available.
  • The rubber duck debugger does stipulate, however, that it is an AI and that it is experimental. Students should be conscious of the degree to which they blindly trust the AI. Consider the following image:

rubber duck giving an answer with a disclaimer

  • AI has an inhuman level of patience.

Generative AI​

  • AI has been with us for much time! Software has long adapted to users. Algorithms look for patterns in junk mail, images saved on your phone, and to play games.
  • In games, for example, step-by-step instructions may allow a computerized adversary play a game of Breakout.

Decision Trees​

  • Decision trees are used by an algorithm to decide what decision to make.
  • For example, in Breakout, an algorithm may consider what choice to make based on the instructions in the code:
While game is ongoing:
If ball is left of paddle:
  Move paddle left
Else if ball is right of padding:
  Move paddle right
Else:
  Don't move paddle
  • With most games, they attempt to minimize the number of calculations required to compete with the player.

Minimax​

  • You can imagine where an algorithm may score outcomes as positive, negative, and neutral.
  • In tic-tac-toe, the AI may consider a board where the computer wins as 1 and one where the computer loses as -1.
  • You can imagine how a computer may look at a decision tree of potential outcomes and assign scores to each potential move.
  • The computer will attempt to win by maximizing its own score.
  • In the context of tic-tac-toe, the algorithm may conceptualize this as follows:
If player is X:
For each possible move:
  Calculate score for board
Choose move with highest score

Else if player is O:
  For each possible move:
    Calculate score for board
  Choose move with lowest score
  • This could be pictured as follows:

tictactoe with outcomes as 1 or -1 or 0

  • Because computers are so powerful, they can crunch massive potential outcomes. However, the computers in our pockets or on our desks may not be able to calculate trillions of options. This is where machine learning can help.

Machine Learning​

  • Machine learning is a way by which a computer can learn through reinforcement.
  • A computer can learn how to flip a pancake.
  • A computer can learn how to play Mario.
  • A computer can learn how to play The Floor is Lava.
  • The computer repeats trial after trial after trial to discover what behaviors to repeat and those not to repeat.
  • Within much of AI-based algorithms, there are concepts of explore vs. exploit, where the AI may randomly try something that may not be considered optimal. Randomness can yield better outcomes.

Deep Learning​

  • Deep learning uses neural networks whereby problems and solutions are explored.
  • For example, deep learning may attempt to predict whether a blue or red dot will appear somewhere on a graph. Consider the following image:

blue dots and red dots separated by a line

  • Existing training data is used to predict an outcome. Further, more training data may be created by the AI to discover further patterns.
  • Deep learning creates nodes (pictured below), which associate inputs and outputs.

Nodes connected to notes

Generative Artificial Intelligence​

  • Large language models are massive models that make predictions based on huge amounts of training.
  • Just a few years ago, AI was not very good at completing and generating sentences.
  • The AI encodes words into embeddings to find relationships between words. Thus, through a huge amount of training, a massive neural network can predict the association between words - resulting in the ability for generative AI to generate content and even have conversations with users.
  • These technologies are what is behind our rubber duck debugger.

Summing Up​

In this lesson, you learned about some of the technology behind our own rubber duck debugger. Specifically, we discussed…

  • Image Generation
  • ChatGPT
  • Prompt Generation
  • CS50.ai
  • Generative AI
  • Decision Trees
  • Minimax
  • Machine Learning
  • Deep Learning
  • Generative Artificial Intelligence

This was CS50!

>>> Slide PDF

>>> Source