OpenAI's Secret Weapon? You Won’t Believe What Codex Can Do for Your Coding Projects!

OpenAI, the company behind the popular AI chatbot ChatGPT, is testing a new feature for its coding assistant, Codex, called "Chronicle." This feature has drawn comparisons to Microsoft’s controversial Windows Recall, which was rolled out in 2024. Chronicle aims to enhance Codex’s ability to remember user context by automatically capturing screenshots of a user’s workspace.

According to documentation reviewed by The Register, Chronicle is designed to improve Codex’s contextual understanding by documenting what users are working on. The documentation states, “Chronicle augments Codex memories with context from your screen. When you prompt Codex, those memories can help it understand what you've been working on with less need for you to restate context.” This means that Codex will periodically take screenshots, using Optical Character Recognition (OCR) and other tools to extract relevant text and context. This information is then converted into memory files that the AI can reference in future sessions.

The primary concern surrounding Chronicle arises from its similarities to Windows Recall, which automatically captures screenshots of a user’s desktop every few seconds to enhance its Copilot AI assistance. Privacy researchers have expressed concerns about how such features could store sensitive information. Security researcher Michael Taggart remarked, “Oh my god, OpenAI reinvented Recall, but for macOS.” Unlike Windows Recall, which is mandatory, Chronicle is currently an opt-in feature available only for macOS users.

OpenAI has stated that screenshots taken by Chronicle are temporarily stored on the user's device for a maximum of six hours. Although selected screenshots are sent to OpenAI servers for processing, the company assures users that these images are not permanently stored or used for training purposes. However, users should note that the generated memory files remain on their devices until manually deleted. These files are saved in the directory $CODEX_HOME/memories_extensions/chronicle.

OpenAI has also highlighted potential risks associated with Chronicle. The company warned, “Both directories for your screen captures and memories might contain sensitive information. Make sure you do not share content with others, and be aware that other programs on your computer can also access these files.” The documentation further states that enabling Chronicle could lead to faster consumption of Codex limits and increased vulnerability to prompt injection attacks. Malicious content appearing on-screen could be captured by the AI, creating security risks.

Users must manually enable Chronicle through Codex settings and grant screen recording permissions to utilize this feature. Currently, it is being offered as a research preview for eligible macOS users, and it is not available in the European Union, United Kingdom, or Switzerland.

For developers, Chronicle has the potential to streamline workflows, as it could help Codex automatically understand coding errors, files, and workflows without requiring repetitive prompts. Nevertheless, users who handle sensitive information should carefully evaluate the privacy implications before enabling this feature, given that screen captures and stored memory files may include passwords, private messages, and other confidential data.

As AI technology continues to evolve, features like Chronicle could reshape how users interact with coding assistants and develop software. However, navigating the balance between improved functionality and privacy will be a critical consideration as companies like OpenAI and Microsoft innovate in this space.

You might also like:

Go up