You should make a "Motion Plus" device for the scanner. You know the small dongle Wii added to the first version of controllers.
If the scanner could tell if it is held/moved in a special direction instead of just trusting what it see, it could help stability and quality I think.
If you look at the Iphone with lidar, it is way better at determine what direction it is scanning. Because it uses it sensors together with vision.
Just saying, some gyro and/or accelerometer would probably not hurt.