Pretty fancy chip!
They are advertised to provide a steady 1.5V output, so I think you are right that they regulate it down. The mAhr rating is quite low, so the actual battery is probably fairly small. I wonder if you can charge it with a 6V solar panel or if that would be too high a voltage.