I assume you have spoken with his parents? You can get a restraining order. Talk with the Mayor. Form a neighborhood watch. If you are tough enough you can tell them to leave, but it will have more impression if you gather a bunch of neighbors to go out there en masse.