Figure out if we need to fix this issue or not when running notebook cells

[znorman-harris]

Not an issue per-se, but we get "errors" because the files appear and disappear so quick (and the language server is notified about them).