What do you call these little fluorescent plastic tubes that light up?

Those are called fiber optics, just like the link says in the title. Fiber optics can be made out of different materials and can be acquired and different places online and in stores, your probably looking for the cheap plastic fiber optics.