The bit module uses caching of values but that was my same reaction. It might be usefull to create a cache for the bit operations with a weak table. I would need to do some additional testing to find this out.
Im really not sure on how the new bit32 lib is implemented o.o