Of course you can.....but......
The padding prevents the metal bars from rubbing thru the outer top skin.
Not to mention if your head should happen to hit the inside roof. Hitting those metal bars would hurt.
Someone posted photos of what it looked like, done that way, a long while back.
As always, its your car.