May not be serious, does this happen to you guys?
Yes I do!
Would getting rid of it have any negative affects at all?
I suggest ditching the PCV and plugging the nipple on the intake manifold; replace the PCV with this and run some form of catch can.
On The PCV Valve under a NA application, the Intake manifold will pull a vacuum, evacuating the crankcase pressure, On a boosted application, there is no vacuum, so all that crankcase pressure you are getting from a small amount of ring blow by and windage, the small breather is not enough to be evacuated. The pressure is finding the path of least resistance, which is your dipstick, in essence, if you flip the dipstick around and cannot properly evacuate the additional crankcase pressure, you could end up pushing out the front or rear main seal.
Mine does the same, and I have the same exact crankcase vent setup as you... cheap push-on filter on the crankcase vent and still have the PCV attached. I guess I will start looking for a catch can setup as well to connect to the PCV.



