Issues with soma.web.ControllerWidget

[denisri]

This ticket is not a single issue but will discuss and try to improve soma.web.ControllerWidget. We can summarize a short problems list here (by editing the ticket) and discuss in answers.

• First, I had difficulties when opening it on a controller containing None values. I have fixed a few problems by adding tests, and I will push fixes.
• The ControllerWidget opened on a Morphologist instance displays nothing, without a visible error.
• The ControllerWidget opened on a Morphologist instance displays all values empty.
• Deleting the widget (del controller_widget) doesn't actually destroy it: it remains visible. But gc.collect() does delete it afterwards.
• ControllerWidget lacks the former set_visible() method to hide or show some selected fields
• Values manually modified in ControllerWidget are not marked as modified as they used to do in Capsul 2. This is required to block completion on manually forced fields.
• Fields names / values display layout should be adjusted / fixed. For now they cannot be properly resized, and there is no horizontal scrollbar, thus we need to set the widget fullscreen to get a chance to read the value
• A number of field types are not supported, resulting in the full ControllerWidget to be completely empty.
• Errors like unsupported types are not displayed nor logged and do not raise an exception, thus debugging is difficult.
• A Controller view is either read-only, or completely modifiable, that is not only values can be edited, but fields canbe removed etc. We need a 3rd state where only values can be edited, and fields are fixed (except for OpenKeyControllers).
• We should also be able to specify when expandable fields (like lists, dicts etc) are displayed expanded or folded at the beginning.
• A few fields metadata may prove useful also, in order to display things to the user in tooltips, colors, or other visual hints: for instance input/ouput state, locked fields, or other information. Thus considering this and earlier points in this list, I guess controller descriptions should be passed in a 2-level JSON dict rather than the "direct" one passed now.

[denisri]

How do we debug things in the javascript code ?
There must be a type not handled in Morphologist field somewhere, but I don't know how to figure it out, or print debug messages...

[sapetnioc]

Either you can use a sample code using a http server instead of html in Qt. Or you can trun debugging on for QtWebEngine and use a browser to debug:

https://doc.qt.io/qt-6/qtwebengine-debugging.html

I think the Qt debugging interface in browser doesn't work as well as built-in l browsers one but it is simpler to set up.

[denisri]

Is there a sample code somewhere to start a http server displaying a Controller in soma.web ? I'm afraid I can't do it myself...

[sapetnioc]

Yes, sorry I should have tell it before. There is a sample code in web/__main__.py in the web_server_gui function. This is really for debug but this is helpful so it may be a good idea to put it elsewhere (web/debug.py ?).

[sapetnioc]

I forgot to say that the internal server engine exposes all files in static directories of the various projects using it (for now soma-base, capsul and snapcheck) in a static/{filename} route. Therefore, for web_server_gui sample code, the browser entry point is https://localhost:8080/static/controller.html`. It corrseponds to the file web/static/controller.html.

[denisri]

Ah OK thanks. I could finally start and use the web backend. But for the Morphologist process, nothing is displayed, no error, nothing in the console. However the Morphologist process instance is actually a Controller (with 228 fields), so I don't know where to investigate.

[denisri]

OK this is my example code:

from capsul.api import executable, Capsul
import http, http.server
from soma.web import SomaHTTPHandler, WebBackend

mp = executable('morphologist.capsul.morphologist')

class Handler(SomaHTTPHandler, web_backend=WebBackend(controller=mp)):
    pass

httpd = http.server.HTTPServer(("", 8080), Handler)
httpd.serve_forever()

[denisri]

and the response to the controller request:

_json_result	Object { _json_error_type: "TypeError", _json_error_message: "Type not compatible with JSON schema: pydantic.conlist(float, min_items=3, max_items=3)", _json_traceback: 'Traceback (most recent call last):\n File "/casa/host/build/python/soma/web/__init__.py", line 307, in wrapper\n result = callable(*args, **kwargs)\n File "/casa/host/build/python/soma/web/__init__.py", line 351, in get_view\n "schema": json_controller.get_schema(),\n File "/casa/host/build/python/soma/web/__init__.py", line 47, in get_schema\n schema_type = self._build_json_schema(\n File "/casa/host/build/python/soma/web/__init__.py", line 264, in _build_json_schema\n properties[f.name] = cls._build_json_schema(\n File "/casa/host/build/python/soma/web/__init__.py", line 290, in _build_json_schema\n raise TypeError(\nTypeError: Type not compatible with JSON schema: pydantic.conlist(float, min_items=3, max_items=3)\n' }

thus the type pydantic.conlist(float, min_items=3, max_items=3) (list of 3 floats) is not known.

[sapetnioc]

Do I need some specific branch for morphologist ? I have this error:

Traceback (most recent call last):
  File "/home/yann/dev/casaconda/test.py", line 5, in <module>
    mp = executable('morphologist.capsul.morphologist')
  File "/home/yann/dev/casaconda/src/capsul/capsul/application.py", line 343, in executable
    result = executable_from_python(definition, item)
  File "/home/yann/dev/casaconda/src/capsul/capsul/application.py", line 397, in executable_from_python
    result = item(definition=definition)
  File "/home/yann/dev/casaconda/build/lib/python3.10/site-packages/morphologist/capsul/morphologist.py", line 12, in __init__
    super(Morphologist, self).__init__(
  File "/home/yann/dev/casaconda/build/lib/python3.10/site-packages/morphologist/capsul/axon/axonmorphologist.py", line 18, in __init__
    super(AxonMorphologist, self).__init__(False, **kwargs)
  File "/home/yann/dev/casaconda/src/capsul/capsul/pipeline/pipeline.py", line 248, in __init__
    self.pipeline_definition()
  File "/home/yann/dev/casaconda/build/lib/python3.10/site-packages/morphologist/capsul/morphologist.py", line 21, in pipeline_definition
    self.add_process('importation',
  File "/home/yann/dev/casaconda/src/capsul/capsul/pipeline/pipeline.py", line 414, in add_process
    node = executable(process, **kwargs)
  File "/home/yann/dev/casaconda/src/capsul/capsul/application.py", line 343, in executable
    result = executable_from_python(definition, item)
  File "/home/yann/dev/casaconda/src/capsul/capsul/application.py", line 397, in executable_from_python
    result = item(definition=definition)
  File "/home/yann/dev/casaconda/build/lib/python3.10/site-packages/morphologist/capsul/axon/importt1mri.py", line 16, in __init__
    self.add_trait('input', File(allowed_extensions=['.nii.gz', '.svs', '.bmp', '.dcm', '', '.i', '.v', '.fdf', '.mgh', '.mgz', '.gif', '.ima', '.dim', '.ndpi', '.vms', '.vmu', '.jpg',
  File "/home/yann/dev/casaconda/build/lib/python3.10/site-packages/soma/controller/controller.py", line 631, in __getattr__
    raise AttributeError(
AttributeError: <class 'morphologist.capsul.axon.importt1mri.ImportT1MRI'> object has no attribute 'add_trait'

[denisri]

You need the branch capsul3 of morphologist-gpl, of course :p

[sapetnioc]

I tried with this branch but then I have this error:

Traceback (most recent call last):
  File "/home/yann/dev/casaconda/test.py", line 5, in <module>
    mp = executable('morphologist.capsul.morphologist')
  File "/home/yann/dev/casaconda/src/capsul/capsul/application.py", line 343, in executable
    result = executable_from_python(definition, item)
  File "/home/yann/dev/casaconda/src/capsul/capsul/application.py", line 397, in executable_from_python
    result = item(definition=definition)
  File "/home/yann/dev/casaconda/build/lib/python3.10/site-packages/morphologist/capsul/morphologist.py", line 32, in __init__
    super(Morphologist, self).__init__(
  File "/home/yann/dev/casaconda/build/lib/python3.10/site-packages/morphologist/capsul/axon/axonmorphologist.py", line 16, in __init__
    super(AxonMorphologist, self).__init__(False, **kwargs)
  File "/home/yann/dev/casaconda/src/capsul/capsul/pipeline/pipeline.py", line 248, in __init__
    self.pipeline_definition()
  File "/home/yann/dev/casaconda/build/lib/python3.10/site-packages/morphologist/capsul/morphologist.py", line 43, in pipeline_definition
    super(Morphologist, self).pipeline_definition()
  File "/home/yann/dev/casaconda/build/lib/python3.10/site-packages/morphologist/capsul/axon/axonmorphologist.py", line 249, in pipeline_definition
    self.add_link(
  File "/home/yann/dev/casaconda/src/capsul/capsul/pipeline/pipeline.py", line 923, in add_link
    ) = self.parse_link(link, check=check)
  File "/home/yann/dev/casaconda/src/capsul/capsul/pipeline/pipeline.py", line 798, in parse_link
    dest_node_name, dest_plug_name, dest_node, dest_plug = self.parse_parameter(
  File "/home/yann/dev/casaconda/src/capsul/capsul/pipeline/pipeline.py", line 877, in parse_parameter
    raise ValueError(
ValueError: 'SulciRecognition' is not a valid parameter name for node 'SulciRecognition' 

[sapetnioc]

By the way, it will be easy to have a quick fix for the error because there is already a series of if to convert specific types to JSON schema. However, a complete fix will requires to see how to add the list size constraint in the schema and to take it into account when creating new value for this type. Otherwise new values will be empty lists.