Thanks again for all the detailed insights you’ve shared. I’m really fascinated by how your systems handle adaptation, pattern validation, and the separation between behavioral changes and factual rigor.
I’m a future OpenAI tester, and I’m very interested in exploring, testing, and understanding exactly how these models work: how patterns are created, how memory and signals interact, and how adaptation occurs. I’d love to study similar projects, analyze the code, and see the concepts in action.
If you have any GitHub repositories or example projects you can share, I’d be eager to look into them and learn from them.
Have you asked the AI in the project about this? Sometimes AI are able to do a decent job of providing an answer but then at times they may hallucinate an answer so you will have to see if it works.
I also find that asking for “best practices” at times will give the “best practice” which tends to algin with the training data and thus what the AI will often give and try to use in most cases.
You noted " AGENTS.md instruction", is that really the best place to add this? The prompt might be correct but not being included with your workflow? (Rhetorical questions)
I have run into this permission error as well. In my case, it was resolved either by preventing pytest from creating and using those directories or by switching the cache to a writable path.
You can avoid the issue entirely by disabling pytest’s cache plugin via a pytest.ini file. This prevents creation of the .pytest_cache directory and the pytest-cache-files-* temp directories. The tradeoff is that cached information such as lastfailed and collection node IDs is no longer available. You can also exclude those directories from test collection.
For small projects this is usually fine. Test runs may be slightly slower, and information like last or first failed tests is lost. Some plugins may also rely on the cache, and certain debugging details may no longer be available.
If you do need the cache data, you can instead point the cache to a writable directory. In my case, Codex sometimes required full access for the session.
I have not used pytest in a while, so I cannot say with certainty which warnings are expected and which may be specific to the interaction with Codex. I wouldn’t be at all surprised if it was a Windows bug.
Update (temp path detail):
By default, my pytest temp artifacts are being created under Windows temp, e.g.:
%TEMP%\pytest-of-<user>\pytest-<n>\...
This works perfectly when I run tests manually inside VS Code (Test Explorer / normal terminal).
However, when Codex agent runs pytest, it seems to run inside a sandbox / different execution context where writing to this default pytest temp directory fails (permission / access issue), so the suite cannot complete.
I also tried overriding the temp location to:
inside the repo
inside %USERPROFILE%
a newly created folder per run
…but the Codex extension environment still fails whenever the tests attempt to create/write temp files.