To be very strictly fair, 'tea' does not always mean 'prepared leaves of the tea bush'. It could be something like rose or linden leaf tea.

That said, somehow I doubt Douglass thought that far.