A

Arogya • 3.19K Points
Extraordinary

Q. What is the role of Tokenization in AI models?

  • (A) Encrypting passwords
  • (B) Breaking text into smaller units (tokens)
  • (C) Compressing images
  • (D) Loading configuration
  • Correct Answer - Option(B)
  • Views: 1
  • Filed under category Spring AI
  • Hashtags:
Explanation by: Arogya
LLMs process text as tokens, not full sentences.

You must be Logged in to update hint/solution

Discusssion

Login to discuss.

Be the first to start discuss.