The correct option is (C). \(\frac{\pi}{3}\)
In order to remove xy-term from the equation
ax2 + 2hxy + by2 + 2gx + 2fy + c, the axes are rotated through an angle θ given by
tan 2θ = \(\frac{2h}{a-b}\)
Here, a = 5, b = 9 and h = 2√3
tan 2θ = \(\frac{2h}{a-b}\)
tan θ = \(\frac{4\sqrt3}{5-9} = -\sqrt3\)
\(2\theta = \frac{2\pi}{3}\)
\(\theta = \frac{\pi}{3}\)