You can Insert->Tabular Material *inside* a table cell. With a table inside a table ... one cell can encompass multiple rows in a column alongside a standard column, thereby making the standard table "multirow".
Works best if you use tables without borders, of course. It's all done within LyX. No "Evil Red Text" required.
