Have you looked at File > New from Template > thesis > Acknowledgments.lyx? I would try copying its contents into your thesis. (Note: the template may ask you to let it create a dummy thesis document. You can delete that document once you've determined whether pasting into your actual thesis works.)
Paul