Do you have any idea where exactly they're getting in, or do you just see them appearing inside? Because that's the key. The solutions other people mention about sealing entrances and installing mesh screens are correct, but what usually gets overlooked is that bats **don't only enter where you see them entering**. They look for any crack, gap under the soffit, holes in the blinds, even spots where the window frame doesn't close all the way. If four different ones have shown up in such a short time, it's because there are multiple access points that aren't necessarily obvious.
Start by closing the window after sunset, period. That's the most effective thing. If you need ventilation, use a mosquito screen mesh pulled tight and check that it doesn't have any holes. Then, go through the entire perimeter of your room (especially around windows and in the ceiling area) with a flashlight during the day. Bats are incredibly small, so cracks less than a centimeter wide are enough for them. Forget about ultrasonic devices and flashing lights - that doesn't work. If you find any gaps, seal them with caulk or adhesive weatherstripping.
The other thing that matters: even though you don't see them during the day, they could be nesting somewhere in the house (inside curtains, behind pictures, in rolled-up blinds). Check those places because if there's a nest nearby, they're going to keep trying to get in even if you close the window. If that's the case, you might need something more serious, but try the basics first.