Dijet production has been measured in collisions at a nucleon-nucleon centre-of-mass energy of 5.02. A data sample corresponding to an integrated luminosity of 35 was collected using the Compact Muon Solenoid detector at the Large Hadron Collider. The dijet transverse momentum balance, azimuthal angle correlations, and pseudorapidity distributions are studied as a function of the transverse energy in the forward calorimeters (). For collisions, the dijet transverse momentum ratio and the width of the distribution of dijet azimuthal angle difference are comparable to the same quantities obtained from a simulated reference and insensitive to . In contrast, the mean value of the dijet pseudorapidity is found to change monotonically with increasing , indicating a correlation between the energy emitted at large pseudorapidity and the longitudinal motion of the dijet frame. The pseudorapidity distribution of the dijet system in minimum bias collisions is compared with next-to-leading-order perturbative QCD predictions obtained from both nucleon and nuclear parton distribution functions, and the data more closely match the latter.