Would an alternative fallback be to strip down the font (using, say, FontForge) so that it only includes the characters to be substituted?

Be careful when stripping down fonts. A lot of them only give you a license to use them in their entirety. If you start editing the font, you start breaking their T&C’s.