Breaking up concrete is a hard, hard job, and that is why hiring a professional is well-worth the cost. However, if you have a relatively small slab of concrete, then you may be able to break up the concrete yourself. Below are some hints for breaking up a small section of concrete and disposing of the rubble. Get the Right Tools Keep in mind that using the right tools and equipment for breaking up concrete will make the work less difficult and time-consuming.