There are 2 main types of heat pumps: Air source and Ground source.  This article mainly compares and air source heat pump to a natural gas furnace.  We like the EnergySavers.Gov page on how a Heat pump works.  The biggest drawback to heat pumps is that in cold climate they probably will need supplemental heat, because they can't pull any heat from the outside air if it gets too cold.