Tested and it seems like it can only stay on with being charged. I included an extra charger for this purpose that is third party. I used it to show it working. It was used on a single occasion when it was originally bought.

I could be wrong and it could end up working normally/without a charger plugged in. I left it charged overnight then tested it again but it appears to work for sure when plugged in.