The built-in GPU on Xeons/Opterons/similar hardware is closer than you think. Not everybody needs Quattro/FirePro performance but a lot of people still want workstation/CAD graphics support in the drivers.
Xeon and Opteron CPUs generally don't have integrated GPUs. In fact, the primary difference between Intel's desktop and server LGA1155 CPUs is that most of the server equivalents have the GPU disabled (probably to save power).
