Yes, you can do this using the System.Windows.Forms.Integration.ElementHost class which essentially wraps a WPF element in a WindowsForms Control. Then you can try to use this Control like any other control in Wondows Forms. There may be additional work and details depending upon exactly what you are trying to do.
Here is a little sample that puts a WPF Expander in a grid cell using the style.CellType = "Control". You could also base custom cell types off WPF elements wrapped in ElementHost.
WPFinGrid.zip
