This is definitely a popular topic among competitive programmers. I did some testing of my own and found it's coding abilities to be really weak. It is also unable of coming up with tricky observations. However, it does give you a general direction to solve the problem, even for ≈2000 problems. I gave it problem IOI22D - Digital circuit. It managed to figure out how to do first few subtasks, but didn't make the key observation. Than I explained it the solution for 100, but it was not able to code it up. Then I gave it my own solution (code). I asked it to explain parts of the code and it was able to do it.
This is definitely a popular topic among competitive programmers. I did some testing of my own and found it's coding abilities to be really weak. It is also unable of coming up with tricky observations. However, it does give you a general direction to solve the problem, even for ≈2000 problems.
I gave it problem IOI22D - Digital circuit. It managed to figure out how to do first few subtasks, but didn't make the key observation. Than I explained it the solution for 100, but it was not able to code it up. Then I gave it my own solution (code). I asked it to explain parts of the code and it was able to do it.
Oh noooo competitive programming is ruineddd