Multi-threading

Multi-threading is an important idea in GUI development. If you want to implement background execution or progress bar, you'll usually have to rely on multi-threading.

thread_worker makes multi-threaded implementation much easier, without rewriting the existing single-threaded code. It is available in:

from magicclass.utils import thread_worker

Note

It is named after the thread_worker function originally defined in superqt and napari, which create a new function that will return a "worker" of the original function.

from napari.utils import thread_worker

@thread_worker
def func():
    # do something

worker = func()  # worker is ready to run the original "func"
worker.start()  # the original "func" actually get called

On the other hand, magic-class's thread_worker is a class. It returns a thread_worker object instead of a new function. A thread_worker object will create a function that will start a worker every time it is accessed via self.func. Although they are designed differently, they share very similar API.

Basic Usage

Decorate the methods you want to be multi-threaded and that's it!

import time
from magicclass import magicclass
from magicclass.utils import thread_worker

@magicclass
class Main:
    @thread_worker
    def func(self):
        for i in range(10):
            time.sleep(0.2)  # time consuming function
            print(i)

ui = Main()
ui.show()

During execution of func, the GUI window will not get frozen because function is running in another thread.

Note

If you are running functions programatically, GUI window will be disabled as usual. This is because the run method of QRunnable is called in the main thread, otherwise the second line of code will be executed before the first line of code actually finishes. This behavior is important to keep manual and programatical execution consistent.

If decorated method is a generator, worker will iterate over it until it ends. In the following example:

import time
from magicclass import magicclass
from magicclass.utils import thread_worker

@magicclass
class Main:
    @thread_worker
    def func(self):
        for i in range(3):
            print(i)
            yield i

ui = Main()
ui.show()

after you click the "func" button you'll get output like this.

0
1
2

Connect Callbacks

If you update widgets in a thread_worker, GUI crashes.

import time
from magicclass import magicclass, vfield
from magicclass.utils import thread_worker

@magicclass
class Main:
    yielded_value = vfield(str)
    returned_value = vfield(str)

    @thread_worker
    def func(self, n: int = 10):
        for i in range(n):
            self.yielded_value = str(i)
            time.sleep(0.3)
        self.returned_value = "finished"

ui = Main()
ui.show()

This is because updating widgets must be done in the main thread but thread_worker is executed in a separate thread.

Just like superqt and napari, you can connect callback functions to thread_worker objects. These callback functions are called in the main thread so that you can update widgets safely.

There are six types of callbacks.

  • started ... called when worker started.

  • returned ... called when worker returned some values.

  • errored ... called when worker raised an error.

  • yielded ... called when worker yielded values.

  • finished ... called when worker finished.

  • aborted ... called when worker was aborted by some reasons.

Following example shows how you can update widget every 0.3 second.

import time
from magicclass import magicclass, vfield
from magicclass.utils import thread_worker

@magicclass
class Main:
    yielded_value = vfield(str)
    returned_value = vfield(str)

    @thread_worker
    def func(self, n: int = 10):
        for i in range(n):
            yield str(i)
            time.sleep(0.3)
        return "finished"

    @func.yielded.connect
    def _on_yield(self, value):
        self.yielded_value = value

    @func.returned.connect
    def _on_return(self, value):
        self.returned_value = value

ui = Main()
ui.show()

Better Way to Define Callbacks

New in version 0.6.7.

The returned callbacks and the yielded callbacks are very useful for letting users know the progress and results of the function. However, a problem occurs when you send a lot of information to the callback funcition.

import time
from magicclass import magicclass, vfield
from magicclass.utils import thread_worker

@magicclass
class Main:
    result_1 = vfield(str)
    result_2 = vfield(str)
    result_3 = vfield(str)

    @thread_worker
    def func(self, a: int, b: int):
        r1 = very_heavy_computation_1(a, b)
        r2 = very_heavy_computation_2(a, b)
        r3 = very_heavy_computation_3(a, b)
        return r1, r2, r2

    @func.returned.connect
    def _on_return(self, value):
        r1, r2, r3 = value  # hmmm...
        self.result_1 = r1
        self.result_2 = r2
        self.result_3 = r3

ui = Main()
ui.show()

You'll have to return all the values required for updating the widgets. In terms of readability, the this code is awful. You also have to annotate the second argument of _on_return with a very long tuple[...] type.

Here, you can use thread_worker.to_callback static method. This method converts a function into a Callback object, which will be called if a thread worker detected it as a returned/yielded value.

import time
from magicclass import magicclass, vfield
from magicclass.utils import thread_worker

@magicclass
class Main:
    result_1 = vfield(str)
    result_2 = vfield(str)
    result_3 = vfield(str)

    @thread_worker
    def func(self, a: int, b: int):
        r1 = very_heavy_computation_1(a, b)
        r2 = very_heavy_computation_2(a, b)
        r3 = very_heavy_computation_3(a, b)

        # write things in a function
        @thread_worker.to_callback
        def _return_callback():
            self.result_1 = r1
            self.result_2 = r2
            self.result_3 = r3
        return _return_callback

    @thread_worker
    def gen(self):
        @thread_worker.to_callback
        def _yield_callback():
            # r1, r2, r3 are non-local variables
            self.result_1 = r1
            self.result_2 = r2
            self.result_3 = r3
        for a in range(5):
            r1 = very_heavy_computation_1(a, 0)
            r2 = very_heavy_computation_2(a, 0)
            r3 = very_heavy_computation_3(a, 0)
            yield _yield_callback

ui = Main()
ui.show()

Use Progress Bar

How to use it?

Just like napari, you can use the embeded progress bar to display the progress of the current function call using progress=... argument. Same options are available in magic-class but you can choose which progress bar to use.

  1. If the main window does not have magicgui.widgets.ProgressBar widget, a popup progress bar widget will be created. napari's progress bar will be used instead if it is available.

    @magicclass
    class Main:
        @thread_worker(progress={"total": 10})
        def func(self):
        for i in range(10):
            time.sleep(0.1)
    
  2. If the main window has at least one magicgui.widgets.ProgressBar widget, the first one will be used.

    @magicclass
    class Main:
        pbar = field(ProgressBar)
        @thread_worker(progress={"total": 10})
        def func(self):
        for i in range(10):
            time.sleep(0.1)
    
  3. If "pbar" option is given, progress bar specified by this option will be used.

    @magicclass
    class Main:
        pbar1 = field(ProgressBar)
        pbar2 = field(ProgressBar)
    
        @thread_worker(progress={"total": 10, "pbar": pbar1})
        def func(self):
            for i in range(10):
                time.sleep(0.1)
    

How to set proper total iteration numbers?

I most cases, iteration numbers vary between function calls depending on the widget states. In magic-class, you can pass a function or an evaluable literal string to the "total" argument.

@magicclass
class Main:
    # Use a getter function.

    def _get_total(self):
        return 10

    @thread_worker(progress={"total": _get_total})
    def func0(self):
        n_iter = self._get_total()
        for i in range(n_iter):
            time.sleep(0.1)
            yield

    # Use a literal. Only the function arguments are available in the namespace.

    @thread_worker(progress={"total": "n_iter"})
    def func1(self, n_iter: int = 10):
        for i in range(n_iter):
            time.sleep(0.1)
            yield

    # Use a literal. Any evaluable literal can be used.

    @thread_worker(progress={"total": "width * height"})
    def func2(self, width: int = 3, height: int = 4):
        for w in range(width):
            for h in range(height):
                print(w * h, end=", ")
                time.sleep(0.1)
                yield
            print()

    # Use a literal. Of course, "self" is the most powerful way.

    n = field(int)

    @thread_worker(progress={"total": "self.n.value"})
    def func3(self):
        for i in range(self.n.value):
            time.sleep(0.1)
            yield

Better way to pass progress bar parameters

New in version 0.6.13..

Parameteres for the progress bar should be passed as a dictionary. This is not good for many reasons such as readability and type hinting. You can use with_progress method for the progress bar configuration.

@magicclass
class Main:
    # instead of `@thread_worker(progress={"total": 10})`
    @thread_worker.with_progress(total=10)
    def func(self):
    for i in range(10):
        time.sleep(0.1)