Generalized spectrogram

In order to view a signal (taken to be a function of time) represented over both time and frequency axis, time–frequency representation is used. Spectrogram is one of the most popular time-frequency representation, and generalized spectrogram, also called "two-window spectrogram", is the generalized application of spectrogram.

Definition

The definiton of the spectrogram relies on the Gabor transform (also called short-time Fourier transform, for short STFT), whose idea is to localize a signal f in time by multiplying it with translations of a window function ${\displaystyle w(t)}$ .

The definition of spectrogram is
${\displaystyle S{P_{x,w}}(t,f)={G_{x,w}}(t,f)G_{_{x,w}}^{*}(t,f)=|{G_{x,w}}(t,f)|^{2}}$ ,
where ${\displaystyle {G_{x,{w_{1}}}}}$  denotes the Gabor Transform of ${\displaystyle x(t)}$ .

Based on the spectrogram, the generalized spectrogram is defined as
${\displaystyle S{P_{x,{w_{1}},{w_{2}}}}(t,f)={G_{x,{w_{1}}}}(t,f)G_{_{x,{w_{2}}}}^{*}(t,f)}$ ,
where ${\displaystyle {G_{x,{w_{1}}}}\left({t,f}\right)=\int _{-\infty }^{\infty }{{w_{1}}\left({t-\tau }\right)x\left(\tau \right)\,{e^{-j2\pi \,f\,\tau }}d\tau }}$ ,
and ${\displaystyle {G_{x,{w_{2}}}}\left({t,f}\right)=\int _{-\infty }^{\infty }{{w_{2}}\left({t-\tau }\right)x\left(\tau \right)\,{e^{-j2\pi \,f\,\tau }}d\tau }}$ 

For ${\displaystyle w_{1}(t)=w_{2}(t)=w(t)}$ , it reduces to the classical spectrogram:
${\displaystyle S{P_{x,w}}(t,f)={G_{x,w}}(t,f)G_{_{x,w}}^{*}(t,f)=|{G_{x,w}}(t,f)|^{2}}$  The feature of Generalized spectrogram is that the window sizes of ${\displaystyle w_{1}(t)}$  and ${\displaystyle w_{2}(t)}$  are different. Since the time-frequency resolution will be affected by the window size, if one choose a wide ${\displaystyle w_{1}(t)}$  and a narrow ${\displaystyle w_{1}(t)}$  (or the opposite), the resolutions of them will be high in different part of spectrogram. After the multiplication of these two Gabor transform, the resolutions of both time and frequency axis will be enhanced.

Properties

• Relation with Wigner Distribution

${\displaystyle {\mathcal {SP}}_{w_{1},w_{2}}(t,f)(x,w)=Wig(w_{1}',w_{2}')*Wig(t,f)(x,w),}$ 

where ${\displaystyle w_{1}'(s):=w_{1}(-s),w_{2}'(s):=w_{2}(-s)}$ 

• Time marginal condition

The generalized spectrogram ${\displaystyle {\mathcal {SP}}_{w_{1},w_{2}}(t,f)(x,w)}$  satisfies the time marginal condition if and only if ${\displaystyle w_{1}w_{2}'=\delta }$ ,

where ${\displaystyle \delta }$  denotes the Dirac delta function

• Frequency marginal condition

The generalized spectrogram ${\displaystyle {\mathcal {SP}}_{w_{1},w_{2}}(t,f)(x,w)}$  satisfies the frequency marginal condition if and only if ${\displaystyle w_{1}w_{2}'=\delta }$ ,

where ${\displaystyle \delta }$  denotes the Dirac delta function

• Conservation of energy

The generalized spectrogram ${\displaystyle {\mathcal {SP}}_{w_{1},w_{2}}(t,f)(x,w)}$  satisfies the conservation of energy if and only if ${\displaystyle (w_{1},w_{2})=1}$ .

• Reality analysis

The generalized spectrogram ${\displaystyle {\mathcal {SP}}_{w_{1},w_{2}}(t,f)(x,w)}$  is real if and only if ${\displaystyle w_{1}=Cw_{2}}$  for some ${\displaystyle C\in \mathbb {R} }$ .

References

• Class notes of Time frequency analysis and wavelet transform -- from Prof. Jian-Jiun Ding's course website
• P. Boggiatto, G. De Donno, and A. Oliaro, “Two window spectrogram and their integrals," Advances and Applications, vol. 205, pp. 251-268, 2009.