Add <title> HTML tag directly in your mdx file. The variable frontmatter.title is exposed from remark-mdx-frontmatter plugin.
<title>
frontmatter.title
remark-mdx-frontmatter
// ./example.mdx <title>{frontmatter.title}</title>