PHYSICAL REVIEW D, cilt.87, sa.7, 2013 (SCI-Expanded)
We study the Higgs sector of the U(1)'-extended minimal supersymmetric standard model with CP violation. This is an extension of the minimal supersymmetric standard model Higgs sector by one singlet field, introduced to generate the mu term dynamically. We are particularly interested in nonstandard decays of Higgs particles, especially of the lightest one, in the presence of CP violating phases for mu(eff) and the soft parameters. We present analytical expressions for neutral and charged Higgs boson masses at tree and one-loop levels, including contributions from top and bottom scalar quark sectors. We then study the production and decay channels of the neutral Higgs for a set of benchmark points consistent with low energy data and relic density constraints. Numerical simulations show that a Higgs boson lighter than 2m(W) can decay in a quite distinctive manner, including invisible modes into two neutralinos (h -> (chi) over tilde (0)(chi) over tilde (0)) up to similar to 50% of the time, when kinematically allowed. The branching ratio into h -> (b) over barb, the dominant decay in the standard model, is reduced in some U(1)' models and enhanced in others, while the branching ratios for the decays h -> tau(+)tau(-), h -> WW*, and h -> ZZ* -> 4l are always reduced with respect to their standard model expectations. This possibility has important implications for testing the U(1)' model both at the LHC and later at the ILC. DOI: 10.1103/PhysRevD.87.075007