How do you subract the hexadecimal?

you can't convert 1011.112 to hex. the reason is simple bcz to convert into hex, first you have to convert in the binary value which must be vary between 0 and 1 only. here you used 2 i;e 1011.112,...

You will be fully satisfied with the following link: http://lyle.smu.edu/~jgd/ee2381/072/handouts/Hex_Arithmetic_072.pdf

The word hexadecimal is composed of hexa-, derived from the Greek έξ (hex) for "six", and -decimal, derived from the Latin for "tenth". - from wikihexadecimal (also called base 16 or hex) is a...

60 in hexadecimal would be 3C