A magma glass furnace is a special variation of the basic glass furnace that uses magma as a source of heat, instead of fuel.
To function, magma glass furnace must be built with at least one of the eight edge tiles occupying an open space with at least 4/7 magma on the next floor down. If the only opening to the magma is under the impassable tile of the building, then magma creatures won't be able to enter the workshop area through the opening; otherwise they can.
Magma glass furnace do not consume any magma from their magma source — you can use a single tile of magma below the furnace as an infinite heat source.