What exactly does "no random tests" issue mean

[theabbie]

I got this as issue in https://www.codewars.com/kata/690b601fbaa640b5d75bbca4
in discourse section
My previous problem was also retired probably for similar reasons
https://www.codewars.com/kata/6901c391512b717a4c69f579

What exactly do they mean? can't find anything related to it in documentation or kata guidelines.

If they mean testcases shouldn't be randomly generated then what do they expect one to do? They weren't simply random they were carefully designed to generate till we get a good set of cases handling each kind of scenario so I don't see why it should be penalized, also if I have to check performance of code it should be expected to have large random tests, because you can't manually construct it.

[dramforever]

Your tests should not only be randomly generated but generated inside the tests. As is, your current tests are only random as in https://xkcd.com/221/ random:

https://docs.codewars.com/authoring/guidelines/submission-tests#random-tests

The goal of random tests is to make the expected return values and their order unpredictable so that only solutions that are actually solving the task may pass.

To elaborate, as is, a solution can simply hard code the expected results and pass your tests.

[theabbie]

ohk, now its clear, just saying "no random tests" was so unclear I felt they are complaining about having random tests rather than about lack of random tests.

thanks!

[theabbie]

@dramforever btw I am still confused, to generate random testcases at runtime wouldnt you need to put correct solution in generator script that evaluates random cases and generates answer. is that allowed? or is there other trick to do so because it we use brute then we cant generate random cases for large inputs.

[theabbie]

nvm, now I get it, actual test code is not shown to user so it's safe to put there.

[theabbie]

@theabbie Did you read the docs that dram linked? There is a lot of information explaining questions like that.

yeah read it, I was thinking the test generator code is public so was confused.