Sounds like you are talking about turbo lag.
During an upshift the RPMs drop and your engine uses a fraction of the air it was intaking. The pressure that was built up under boost is no longer needed and has to go somewhere, so the diverter valve releases it back into the intake. The drop in RPMs also means the amount of exhaust gasses drop, removing the load on the turbine, and thus the compressor it is connected to. It takes a little bit of time for the exhaust pressures that drive the turbine to spool up the compressor to make boost again.