I use several RBL lists, but these checks take some time, can I speed this up?

Yes, you can use a DNS cache engine such as djbdns. You can install this along with the dnscache option. This will cache the results of your RBL lookups....saving you the time of having to repeat RBL checks on the same IP's. Depending on your traffic this can save you quite a bit of time.