Removing Label Adhesive From Clear Plastic Container The container came with the requisite front and rear paper label, which was probably applied by some kind of high-speed, automated machinery. I was successful in removing the paper labels, with warm water and soap - and a very nominal amount of scrubbing (more like just rubbing), but the glue adhesive has defied my efforts to remove it.