Certainly not. Most plays belonging to this category will make you think and even laugh if you get to appreciate their hilarious sense of humor, often with an important message.
Actually, some experts dislike the label "Absurd Theatre" and use alternative ones instead.
See the Related Links for "The Theatre of the Absurd - Origins and Development" to the bottom for the answer.