A

Arogya • 2.57K Points
Extraordinary

Q. What is tokenization in LLaMA?

  • (A) Compressing files
  • (B) Breaking text into smaller units
  • (C) Encrypting messages
  • (D) Deleting stop words only
  • Correct Answer - Option(B)
  • Views: 1
  • Filed under category Llama
  • Hashtags:
Explanation by: Arogya
Tokenization converts sentences into tokens that the model can understand.

You must be Logged in to update hint/solution

Discusssion

Login to discuss.

Be the first to start discuss.