Confidence in testingApril 23, 2020 at 3:04am
Not a content request, but I was wondering how comprehensive is testing on the platform? Since I couldn't find a way look at the tests that were ran on a solution, I wasn't sure how confident I should be in my answer if it was accepted.
April 26, 2020 at 2:26am
Hi! Thanks for asking. The testing is not crazy comprehensive. Some problems are decent with tests while others have <5 tests. We launched at the end of January and as a service have only been up for 3 months at the writing of this reply.
We also have to go back and translate all 130+ problems with code solutions into these languages as well. We are working as fast as we can.
We are aware of all of the UI, UX, internal problems etc. We are working rapidly, we are tracking them, and we will fix them.
We are releasing C++ in 1-2 weeks and then we will likely take a step back and revisit these testcases to strengthen them, make the runtime clock much more accurate, etc.
Just stick with us and check back in if you'd like. Keep in touch, we are moving as fast as we can. Other services like Leetcode (alive since 2011, 9 years) and AlgoExpert (alive since 2017 I think? 3 years) have been around. We are working rapidly and getting a lot done fast so just stick with us and these problems will abate.
TL;DR: Testing coverage can be better, we can be more thorough. We just released C# today. We will make them much stronger after we release C++ in 1-2 weeks.