Problem with removing bayer filter is that you also remove the micro lenses. Each pixel has a microlens, which is on top of the bayer filter.
Read somewhere that without these micro lenses, the sensor gets way less light...
But you gain some light by removing the bayer filter, so it accepts all available light...
Not sure how this works outing real life though
