Sounds like it might actually be on the fuser roller, not the drum (I say this because OP said it "baked on ".
If this is the case you might try running a few prints through the unit to heat the fuser (and thus the adhesive) up...it might be easier to clean at that point, but i would avoid most chemicals unless you know what to expect when they get super heated. a lint free cloth and a bit of Alcohol for moisture would probably be your best bet there...but be aware the fuser roller will be very hot and it's quite easy to burn yourself even through a cloth when trying to clean a hot roller.