Some random dictionary on the net told me that by the bye and by the bye are the same thing and are used to denote digression... Finally, I am at peace.