Another goofy example is I asked it a python question using a specific package import . I sent a big chunk of code. It answered using a package I wasn’t even importing breaking everything. It could never figure it out either lol
Yeah, that kind of thing requires reasoning, and it goes awry almost immediately. It’s still pretty useful for generating snippets of boilerplate or finding stuff in big chunks of code, but I more or less gave up on having it actually create anything nontrivial in code.
I didn’t consider length! That’s a good point too
Another goofy example is I asked it a python question using a specific package import . I sent a big chunk of code. It answered using a package I wasn’t even importing breaking everything. It could never figure it out either lol
Yeah, that kind of thing requires reasoning, and it goes awry almost immediately. It’s still pretty useful for generating snippets of boilerplate or finding stuff in big chunks of code, but I more or less gave up on having it actually create anything nontrivial in code.