According to an observation of A.V. Bitsadze from 1948 the Dirichlet problem for bianalytic functions is ill-posed. A natural boundary condition for the polyanalytic operator, however, is the Schwarz condition. An integral representation for the solutions in the unit disc to the inhomogeneous polyanalytic equation satisfying Schwarz boundary conditions is known. This representation is extended here to any simply connected plane domain having a harmonic Green function. Some other boundary value problems are investigated with some Dirichlet and Neumann conditions illuminating that just the Schwarz problem is a natural boundary condition for the Bitsadze operator.