Support typst with manim

[pavelzw]

Description of proposed feature

It would be nice to have support for the typst typesetting language next to LaTeX.
https://github.com/typst/typst

How can the new feature be used?

from manim import *

complex_typst_example = \
"""$ frac(a^2, 2) $
$ vec(1, 2, delim: "[") $
$ mat(1, 2; 3, 4) $
$ lim_x =
    op("lim", limits: #true)_x $
"""

class Formula(Scene):
    def construct(self):
        s = Typst(f"This is normal text rendered with typst.")
        t = MathTypst("A = pi r^2")
        u = Typst(complex_typst_example)

        self.add(s)
        self.add(t)
        self.add(u)

See https://typst.app/docs/reference/math/ for the typst math introduction.

[uwezi]

I would guess the problem is not so much for Manim to be able to accept typst-formatted input, since it is only a string. But is there any similar interface for external rendering of typst-formatted text which results in a graphical representation as there is for LaTeX?

To give you the basics on how LaTeX in Manim works: you enter your string in a Tex() or MathTex() object, which is then sent to the LaTeX-interpreter installed on your computer. This interpreter then creates an output file, usually a .dvi-file, which then by yet another external program is converted into an SVG-image. It is this image which is then re-imported into Manim and included into your scene.

As far as I can see, typst only exists as an online cloud-service with a web-interface, without any standalone, downloadable version or even web-api...

Ok, I was mistaken, since I see that there actually seems to be a standalone application in the github repo which you linked...

[vaclavblazej]

@uwezi The linked source code https://github.com/typst/typst has some installation instructions and terminal compilation to pdf.

[uwezi]

@uwezi The linked source code https://github.com/typst/typst has some installation instructions and terminal compilation to pdf.

As I pointed out at the end I finally figured it out. And the PDF can be converted to SVG (or even PNG) using pdftocairo which comes with MikTex on my computer... In order to get a "standalone"-like behavior you need to define the page #set page(width:auto,height:auto,margin:0cm) however, with a 0 cm margin typst cuts off parts of the text extending below the baseline...

(I will not argue here that I don't see why typst should be easier or simpler than LaTeX in the context of use with Manim)

#set page(width:auto,height:auto,margin:0cm)
= Introduction
In this report, we will explore the
various factors that influence _fluid
dynamics_ in glaciers and how they
contribute to the formation and
behavior of these natural structures.

$ frac(a^2, 2) $
$ vec(1, 2, delim: "[") $
$ mat(1, 2; 3, 4) $
$ lim_x =
    op("lim", limits: #true)_x $

test.pdf

[pavelzw]

I will not argue here that I don't see why typst should be easier or simpler than LaTeX in the context of use with Manim

I personally find LaTeX to be quite annoying to install. Having a light-weight alternative to LaTeX that succeeds to do most things that LaTeX can also do is why I really like the typst project.

Having typst support in manim would make it easier for people who don't have a properly configured LaTeX setup on their machine to use mathematical expressions and also make automated CI setup for manim way easier since installing LaTeX also takes quite some time in CI.

Another reason could be performance; but I'm not sure how much LaTeX rendering actually contributes to manim compilation times.

[pavelzw]

And the PDF can be converted to SVG (or even PNG) using pdftocairo which comes with MikTex on my computer...

typst actually has native support for png output and svg output (svg since typst/typst#1729, not released yet) so you don't even need third-party tools to do this.

This is my output with your typst file:

$ typst compile manim.typ
$ typst compile --ppi 600 manim.typ manim.png
$ typst compile manim.typ manim.svg

manim.pdf
manim.png
manim.svg

[pavelzw]

There also seem to be python bindings for typst:
https://github.com/messense/typst-py

[uwezi]

I don't think that python bindings would be necessary. Running the command line tool on a temporary file just like in the LaTeX case should work perfectly fine. Typst then creates a PDF output which can be read and converted into an SVG stream using pymupdf .
(Sadly) the SVG stream then needs to be written into another temporary file in order to be re-imported into Manim using the SVGMobject. Using my typst code up there and the PDF created by typst I succeeded with the following code:

from manim import *
import fitz

class test(Scene):
    def construct(self):      
        doc = fitz.open(r"bilder/test.pdf")

        page = doc.load_page(0)
        svg = page.get_svg_image()
        
        file = open(r"media/20230822_test.svg", "w")
        file.write(svg)
        file.close()

        svgmobj = SVGMobject(r"media/20230822_test.svg").set_color(WHITE).scale_to_fit_width(14)
        self.add(svgmobj)
        self.add(index_labels(svgmobj).set_color(RED).shift(UR))

to get this output:

The index labels indicate that there is nothing special going on with the conversion of the glyphs, so that later animations should be straightforward.

It feels a bit weird that the SVG data has to be written and then read back - but currently there is no Manim object which interprets SVG data which already is in memory and I did not succeed to fake a file input using io.StringIO, the network of methods inside the SVGMobject is too much to comprehend for me right now.

[uwezi]

native support for png output and svg output

well, I didn't know that - it would make the whole process even simpler and not much of an implementation would be needed. All the pre-processing of LaTeX strings for splitting which does not work reliably could be skipped in my opinion...

[pavelzw]

I don't think that python bindings would be necessary.

When the Python bindings support direct compilation from a string instead of a file (messense/typst-py#4) I think the Manim implementation could be a bit nicer without the need to write the typst code directly to disk and compiling it afterwards but doing everything in memory.
Also, you wouldn't even need typst installed but can do everything within the python bindings.

[MrDiver]

🤔 so it's probably possible to do that. One thing i would ask for this is how would you decide on which one to use, because by default we expect Latex to be present on the system for things like the Tex object, so should it just be a general Typst object then ? Like the Tex object ? Or what would be the idea on that ?

[pavelzw]

I think something like a Typst(content: str) object for regular typst stuff and a MathTypst(content: str, display_mode: Literal["inline", "display"]) object for inline math ($x = sum_(i=1)^n i$) and display mode math ($ x = sum_(i=1)^n i $) would make sense.

I would make it somewhat similar to the Tex object with the exception that Typst doesn't need to be preinstalled but comes as an optional dependency with typst-py.