Google Unveils Gemini 1.5 AI With Million-Token Context Window for Advanced Reasoning and Understanding
-
Gemini 1.5 is Google's next-generation AI model with a breakthrough 1 million token context window, the longest of any large foundation model. This allows it to process more text/data at once.
-
The longer context window helps the model "remember" information during conversations and tasks, reducing the need to provide context repeatedly.
-
Scaling to 1 million tokens required multiple innovations in deep learning that built off each other. The team is now testing up to 10 million tokens in research.
-
The expanded context window enables new capabilities - summarizing thousands of pages of text, analyzing tens of thousands of lines of code, reasoning across full documents provided in a prompt.
-
Gemini 1.5 Pro with the 1 million token context window is available in private preview to select developers. Work continues to improve efficiency and safety as context is further expanded.