Answering my own question, yes, it works without a battery. It will popup a notification of low battery sometimes, and obviously it won't work wirelessly.

Ah, and I tried this with a CTL6100 tablet, so this guide is valid for this model as well (a bit larger but mostly identical inside).

Will it work without a battery?