Yes, you should be rinsing your rice every time.
Cut through the grime with basic cleaners.