Oh yes, particularly when they are of the generic "everyone from that country talks like this" kind, and paired with random interjections in the native language, usually of very simple words. When I'm speaking or writing English, I may not always remember the words for difficult concepts, but I can manage "yes" and "no" and won't randomly start saying "ja" und "nein".

[Brought to you by the society for "Frau author, we don't all sound like ze Nazis from ze World War II movies, nein!"