Describe the problem you are having

I used a python script to crop the images from my camera with the same coordinates provided in the config file for Swatch. I then uploaded the cropped images to Swatch to get the color values. Below are the results of this test as well as the result of running detect on the original uncropped pictures.

midday:
{
    "message": "The dominant color is (151, 36, 46) with a mixed palette as [(156, 39, 49), (183, 168, 169), (203, 139, 150), (85, 6, 13)]",
    "success": true
}

{
    "door": {
        "stop_sign": {
            "area": 81,
            "result": false
        }
    }
}

night_lights_on:
{
    "message": "The dominant color is (64, 22, 26) with a mixed palette as [(62, 14, 18), (79, 74, 74), (130, 84, 90), (84, 60, 68)]",
    "success": true
}

{
    "door": {
        "stop_sign": {
            "area": 99,
            "result": false
        }
    }
}

night_spotlight:
{
    "message": "The dominant color is (121, 64, 79) with a mixed palette as [(119, 62, 77), (203, 137, 152), (165, 119, 150), (163, 120, 127)]",
    "success": true
}

{
    "door": {
        "stop_sign": {
            "area": 846,
            "result": false
        }
    }
}

night_door_open:
{
    "message": "The dominant color is (19, 20, 19) with a mixed palette as [(11, 12, 12), (19, 20, 19), (4, 4, 4), (28, 26, 27)]",
    "success": true
}

{
    "door": {
        "stop_sign": {
            "area": 111,
            "result": false
        }
    }
}

I am not sure what lower and upper color values or min/max pixel thresholds I should use so that the first 3 situations are detected and the last one isn't. Any combination I use either one is incorrectly missed or incorrectly detected. For some reason, even when I had the lower RGB values larger than the values of the 4th situations, Swatch marked it as true.

Version

1.0.0

Swatch config file

# REQUIRED: Define a list of objects that are expected to be seen. These can be specific
# to one camera or common between many / all cameras
objects:
  # REQUIRED: Name of the object
  stop_sign:
    # REQUIRED: the lower R, G, B values that are considered a potential match for the object.
    color_lower: 64, 22, 26
    # REQUIRED: the upper R, G, B values that are considered a potential match for the object.
    color_upper: 151, 36, 46
    # OPTIONAL: the min number of pixels with R, G, B values within the bounds to be
    # considered a true positive. This is recommended to be set as a super small amount
    # could be a false positive. (Default: shown below)
    min_area: 1000
    # OPTIONAL: the max number of pixels with R, G, B values within the bounds to be
    # considered a true positive (Default: shown below).
    max_area: 100000

# REQUIRED: Define list of cameras that will be used for color detection.
cameras:
  # REQUIRED: Name of the camera
  garage_cam:
    # REQUIRED: Zones are cropped areas where the object can be expected to be. 
    # This makes searching / matches for efficient and more predictable than searching
    # the entire image.
    zones:
      # REQUIRED: Name of the zone.
      door:
        # REQUIRED: Coordinates to crop the zone by. 
        coordinates: 645, 712, 1368, 1434
        # REQUIRED: List of objects that may be in this zone. These correspond to
        # the objects list defined previously and are matched by name.
        objects:
          - stop_sign

Relevant log output

N/A

Any other information that may be helpful

No response

Describe the problem you are having

Can't access WebUI - 502 bad gateway error

Repository has been added, and add-on installed. I have also installed the HACS integration. I tried to setup the normal integration (which is now showing up) but wasn't sure if I'm pointing to the right URL as I'm getting an error back on that.

Bigger issue seems to be with getting into the WebUI

Version

3.0.2

Swatch config file

# REQUIRED: Define a list of objects that are expected to be seen. These can be specific
# to one camera or common between many / all cameras
objects:
  # REQUIRED: Name of the object
  trash_can:
    # REQUIRED: the list of color variants that this object can be detected as. Useful for
    # different lighting conditions
    color_variants:
      # REQUIRED: the name of the color variant
      default:
        # REQUIRED: the lower R, G, B values that are considered a potential match for the
        # color variant of the object.
        color_lower: 70, 70, 0
        # REQUIRED: the upper R, G, B values that are considered a potential match for the
        # color variant of the object.
        color_upper: 110, 100, 50
        # OPTIONAL: the time range for when this color variant is allowed
        # NOTE: make sure that /etc/localtime is passed to the container so it has valid time
        time_range:
          # OPTIONAL: Color variant is valid if current time is > this 24H time (Default: shown below).
          after: "00:00"
          # OPTIONAL: Color variant is valid if current time is < this 24H time (Default: shown below).
          before: "24:00"
    # OPTIONAL: the min number of pixels with R, G, B values within the bounds to be
    # considered a true positive. This is recommended to be set as a super small amount
    # could be a false positive. (Default: shown below)
    min_area: 1000
    # OPTIONAL: the max number of pixels with R, G, B values within the bounds to be
    # considered a true positive (Default: shown below).
    max_area: 100000
    
# REQUIRED: Define list of cameras that will be used for color detection.
cameras:
  # REQUIRED: Name of the camera
  GR:
    # OPTIONAL: Frequency in seconds to run detection on the camera.
    # a value of 0 disables auto detection (Default: shown below).
    auto_detect: 0
    # OPTIONAL: Configure the url and retention of snapshots. (Default: Shown Below)
    snapshot_config:
        # OPTIONAL: but highly recommended, setting the default url for a snapshot to be
        # processed by this camera. This is required for auto detection (Default: none).
        url: "http://ip.ad.dr.ess/jpg"
        # OPTIONAL: Whether or not to draw bounding boxes for confirmed objects in the snapshots (Default: shown below).
        bounding_box: true
        # OPTIONAL: Whether or not to save a clean png of the snapshot along with the annotated jpg (Default: shown below).
        clean_snapshot: true
        # OPTIONAL: Whether or not to save the snapshots of confirmed detections (Default: shown below).
        save_detections: true
        # OPTIONAL: Whether or not to save the snapshots of missed detections (Default: shown below).
        save_misses: false
        # OPTIONAL: Variations of snapshots to keep. Options are all, mask, crop (Default: shown below).
        mode: "all"
        # OPTIONAL: Number of days of snapshots to keep (Default: shown below).
        retain_days: 7
    # REQUIRED: Zones are cropped areas where the object can be expected to be.
    # This makes searching / matches for efficient and more predictable than searching
    # the entire image.
    zones:
      # REQUIRED: Name of the zone.
      street:
        # REQUIRED: Coordinates to crop the zone by.
        # NOTE: The order of the coordinates are: x, y, x+w, y+h starting in the top left corner as 0, 0.
        coordinates: 225, 540, 350, 620
        # REQUIRED: List of objects that may be in this zone. These correspond to
        # the objects list defined previously and are matched by name.
        objects:
          - trash_can

Relevant log output

[2022-06-08 14:13:47,455]: INFO - Starting SwatchApp
[2022-06-08 14:13:47,464]: INFO - Importing SwatchApp Config
[2022-06-08 14:13:47,464]: INFO - Verified SwatchApp Config
Starting migrations
[2022-06-08 14:13:47,480]: INFO - Starting migrations
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3113, in connect
    self._state.set_connection(self._connect())
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3453, in _connect
    conn = sqlite3.connect(self.database, timeout=self._timeout,
sqlite3.OperationalError: unable to open database file
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3175, in execute_sql
    cursor = self.cursor(commit)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3159, in cursor
    self.connect()
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3112, in connect
    with __exception_wrapper__:
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 2950, in __exit__
    reraise(new_type, new_type(exc_value, *exc_args), traceback)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 191, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3113, in connect
    self._state.set_connection(self._connect())
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3453, in _connect
    conn = sqlite3.connect(self.database, timeout=self._timeout,
peewee.OperationalError: unable to open database file
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/opt/swatch/swatch/__main__.py", line 14, in <module>
    swatch_app = SwatchApp()
  File "/opt/swatch/swatch/app.py", line 44, in __init__
    self.__init_db__()
  File "/opt/swatch/swatch/app.py", line 74, in __init_db__
    router.run()
  File "/usr/local/lib/python3.10/site-packages/peewee_migrate/router.py", line 201, in run
    diff = self.diff
  File "/usr/local/lib/python3.10/site-packages/peewee_migrate/router.py", line 75, in diff
    done = set(self.done)
  File "/usr/local/lib/python3.10/site-packages/peewee_migrate/router.py", line 70, in done
    return [mm.name for mm in self.model.select().order_by(self.model.id)]
  File "/usr/local/lib/python3.10/functools.py", line 981, in __get__
    val = self.func(instance)
  File "/usr/local/lib/python3.10/site-packages/peewee_migrate/router.py", line 59, in model
    MigrateHistory.create_table(True)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 6758, in create_table
    cls._schema.create_all(safe, **options)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 5861, in create_all
    self.create_table(safe, **table_options)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 5716, in create_table
    self.database.execute(self._create_table(safe=safe, **options))
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3190, in execute
    return self.execute_sql(sql, params, commit=commit)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3174, in execute_sql
    with __exception_wrapper__:
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 2950, in __exit__
    reraise(new_type, new_type(exc_value, *exc_args), traceback)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 191, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3175, in execute_sql
    cursor = self.cursor(commit)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3159, in cursor
    self.connect()
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3112, in connect
    with __exception_wrapper__:
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 2950, in __exit__
    reraise(new_type, new_type(exc_value, *exc_args), traceback)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 191, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3113, in connect
    self._state.set_connection(self._connect())
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3453, in _connect
    conn = sqlite3.connect(self.database, timeout=self._timeout,
peewee.OperationalError: unable to open database file

Any other information that may be helpful

No response

Describe the problem you are having

I've setup a zone that crops my image down to this:

In the config file you'll see the color variant I've setup (color_lower: 0, 0, 150, color_upper: 255, 130, 255)

I've not seen any detections triggered. Do I have the color variant range setup correctly? I've triggered new snapshots that contain the same amount of color as the image above.

Logs were sparse

Version

3.0.3

Swatch config file

objects:
  water_meter:
    color_variants:
      default:
        color_lower: 0, 0, 150
        color_upper: 255, 130, 255
    
cameras:
  BB_Camera:
    snapshot_config:
        url: "http://HA/lastimage.jpeg"
    zones:
      full_view:
        coordinates: 225, 25, 360, 360
        objects:
          - water_meter
      water_needed:
        coordinates: 300, 300, 365, 360
        objects:
          - water_meter

Relevant log output

[2022-06-08 22:32:03,141]: INFO - Starting SwatchApp
[2022-06-08 22:32:03,150]: INFO - Importing SwatchApp Config
[2022-06-08 22:32:03,150]: INFO - Verified SwatchApp Config
Starting migrations
[2022-06-08 22:32:03,154]: INFO - Starting migrations
There is nothing to migrate
[2022-06-08 22:32:03,164]: INFO - There is nothing to migrate
[2022-06-08 22:32:03,166]: INFO - Starting snapshot cleanup
[2022-06-08 22:32:03,166]: INFO - Starting Detection Cleanup

Any other information that may be helpful

Thanks in advance - really excited about getting this across the finish line

Describe the problem you are having

Hi! Trying to test this, but just updated and now it wont start. Gives error related to database? I'm running inside home assistant and as a ad don. Wonder if it is related to that?

Version

2.2.0

Swatch config file

# REQUIRED: Define list of cameras that will be used for color detection.
cameras:
  # REQUIRED: Name of the camera
  autokatos:
    # OPTIONAL: Frequency in seconds to run detection on the camera.
    # a value of 0 disables auto detection (Default: shown below).
    auto_detect: 10
    # OPTIONAL: Configure the url and retention of snapshots. (Default: Shown Below)
    snapshot_config:
        # OPTIONAL: but highly recommended, setting the default url for a snapshot to be
        # processed by this camera. This is required for auto detection (Default: none).
        url: "http://xxxx/cgi-bin/api.cgi?cmd=Snap&channel=6&rs=qwerty&user=xxxxx&password=xxxx"
        # OPTIONAL: Whether or not to save the snapshots of confirmed detections (Default: shown below).
        save_detections: true
        # OPTIONAL: Whether or not to save the snapshots of missed detections (Default: shown below).
        save_misses: true
        # OPTIONAL: Variations of snapshots to keep. Options are all, mask, crop (Default: shown below).
        mode: "all"
        # OPTIONAL: Number of days of snapshots to keep (Default: shown below).
        retain_days: 7
    # REQUIRED: Zones are cropped areas where the object can be expected to be.
    # This makes searching / matches for efficient and more predictable than searching
    # the entire image.
    zones:
      # REQUIRED: Name of the zone.
      vasenpuoli:
        # REQUIRED: Coordinates to crop the zone by.
        # NOTE: The order of the coordinates are: y, y+h, x, x+w starting in the top left corner as 0, 0.
        coordinates: 0,500,0,500
        # REQUIRED: List of objects that may be in this zone. These correspond to
        # the objects list defined previously and are matched by name.
        objects:
          - fiat
# REQUIRED: Define a list of objects that are expected to be seen. These can be specific
# to one camera or common between many / all cameras
objects:
  # REQUIRED: Name of the object
  fiat:
    # REQUIRED: the list of color variants that this object can be detected as. Useful for
    # different lighting conditions
    color_variants:
      name_of_variant:
        color_lower: 6, 21, 79
        color_upper: 255, 132, 252
        # OPTIONAL: the time range for when this color variant is allowed
        # NOTE: make sure that /etc/localtime is passed to the container so it has valid time
        #time_range:
          # OPTIONAL: Color variant is valid if current time is > this 24H time (Default: shown below).
          #after: "00:00"
          # OPTIONAL: Color variant is valid if current time is < this 24H time (Default: shown below).
          #before: "24:00"
    # OPTIONAL: the min number of pixels with R, G, B values within the bounds to be
    # considered a true positive. This is recommended to be set as a super small amount
    # could be a false positive. (Default: shown below)
    #min_area: 1000
    # OPTIONAL: the max number of pixels with R, G, B values within the bounds to be
    # considered a true positive (Default: shown below).
    #max_area: 100000

Relevant log output

Starting SwatchApp
Importing SwatchApp Config
Verified SwatchApp Config
Starting migrations
There is nothing to migrate
Exception in thread Thread-1 (run):
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3113, in connect
    self._state.set_connection(self._connect())
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3453, in _connect
    conn = sqlite3.connect(self.database, timeout=self._timeout,
sqlite3.OperationalError: unable to open database file
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
    self.run()
  File "/usr/local/lib/python3.10/threading.py", line 946, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/local/lib/python3.10/site-packages/playhouse/sqliteq.py", line 266, in run
    writer.run()
  File "/usr/local/lib/python3.10/site-packages/playhouse/sqliteq.py", line 128, in run
    conn = self.database.connection()
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3153, in connection
    self.connect()
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3112, in connect
    with __exception_wrapper__:
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 2950, in __exit__
    reraise(new_type, new_type(exc_value, *exc_args), traceback)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 191, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3113, in connect
    self._state.set_connection(self._connect())
  File "/usr/local/lib/python3.10/site-packages/peewee.py", line 3453, in _connect
    conn = sqlite3.connect(self.database, timeout=self._timeout,
peewee.OperationalError: unable to open database file
Starting Auto Detection for autokatos
Starting snapshot cleanup
Starting Detection Cleanup

Any other information that may be helpful

No response

Describe the problem you are having

I get the following error when I try to install Swatch. I initially tried to upgrade to 3.1, when that didn't work I tried to uninstall and reinstall swatch.

Failed to install add-on
Can't install crzynik/swatch:3.1.0: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=3.1.0&fromImage=crzynik%2Fswatch&platform=linux%2Famd64: Not Found ("manifest for crzynik/swatch:3.1.0 not found: manifest unknown: manifest unknown")

Updating home assistant doesn't help, restarting ha doesn't help. Restarting the machine doesn't help

I'd love to know what's going on.

Version

3.1

Swatch config file

objects:
  # REQUIRED: Name of the object
  tube_light:
    # REQUIRED: the list of color variants that this object can be detected as. Useful for
    # different lighting conditions
    color_variants:
      # REQUIRED: the name of the color variant
      default:
        # REQUIRED: the lower R, G, B values that are considered a potential match for the
        # color variant of the object.
        color_lower: 70, 70, 0
        # REQUIRED: the upper R, G, B values that are considered a potential match for the
        # color variant of the object.
        color_upper: 110, 100, 50
        # OPTIONAL: the time range for when this color variant is allowed
        # NOTE: make sure that /etc/localtime is passed to the container so it has valid time
        time_range:
          # OPTIONAL: Color variant is valid if current time is > this 24H time (Default: shown below).
          after: "00:00"
          # OPTIONAL: Color variant is valid if current time is < this 24H time (Default: shown below).
          before: "24:00"
    # OPTIONAL: the min area of the bounding box around groups of matching R, G, B pixels
    # considered a true positive. This is not recommended to be set as a super small amount
    # could be a false positive. (Default: shown below)
    min_area: 2
    # OPTIONAL: the max area of the bounding box around groups of pixels with R, G, B
    # values within the bounds to be considered a true positive (Default: shown below).
    max_area: 100000
    # OPTIONAL: the min ratio of width/height of bounding box for valid object detection (default: shown below).
    min_ratio: 0
     # OPTIONAL: the max ratio of width/height of bounding box for valid object detection (default: shown below).
    max_ratio: 24000000
    
cameras:
  # REQUIRED: Name of the camera
  greatroom_cam:
    # OPTIONAL: Frequency in seconds to run detection on the camera.
    # a value of 0 disables auto detection (Default: shown below).
    auto_detect: 30
    # OPTIONAL: Configure the url and retention of snapshots. (Default: Shown Below)
    snapshot_config:
        # OPTIONAL: but highly recommended, setting the default url for a snapshot to be
        # processed by this camera. This is required for auto detection (Default: none).
        url: "http://192.168.0.5:5000/snapshot/dog-cam.jpg"
        # OPTIONAL: Whether or not to draw bounding boxes for confirmed objects in the snapshots (Default: shown below).
        bounding_box: true
        # OPTIONAL: Whether or not to save a clean png of the snapshot along with the annotated jpg (Default: shown below).
        clean_snapshot: true
        # OPTIONAL: Whether or not to save the snapshots of confirmed detections (Default: shown below).
        save_detections: true
        # OPTIONAL: Whether or not to save the snapshots of missed detections (Default: shown below).
        save_misses: false
        # OPTIONAL: Variations of snapshots to keep. Options are all, mask, crop (Default: shown below).
        mode: "all"
        # OPTIONAL: Number of days of snapshots to keep (Default: shown below).
        retain_days: 7
    # REQUIRED: Zones are cropped areas where the object can be expected to be.
    # This makes searching / matches for efficient and more predictable than searching
    # the entire image.
    zones:
      # REQUIRED: Name of the zone.
      livingroom:
        # REQUIRED: Coordinates to crop the zone by.
        # NOTE: The order of the coordinates are: x, y, x+w, y+h starting in the top left corner as 0, 0.
        coordinates: 1000, 0, 1200, 125
        # REQUIRED: List of objects that may be in this zone. These correspond to
        # the objects list defined previously and are matched by name.
        objects:
          - tube_light

Relevant log output

N/A

Any other information that may be helpful

No response

• Do not include file name in creating db path

• Add db tests

• Use consts for env vars

• Formatting

• Only check if the path exists

• Improve test

• Format tests

Fix for #43

• Set version for next release

• Contours (#37)

• Use contours to calculate bounding boxes

• Fix bug

• Add option to draw bounding boxes which is enabled by default

• Add option to docs

• Formatting

• Only cleanup processes if started

• Catch failure correctly

• Supply correct image for object detection

• Update version

• Config options (#38)

• Save bounding box on detection snapshot if enabled

• Add option to save clean png as well.

• Update config options

• Formatting

• Don't crash on bad end time

• Update example images to show the new bounding boxes

• Release cleanup (#39)

• Cleanup logging templates

• Use specific logger with name

• Catch connection errors when saving snapshots

• Fix file names and logging

• Use better exceptions

• Improve logging

• Move color utils to own module

• Use same mask image

• Fix test image

• Formatting

• Cleanup errors and fix bugs

• Disable animation between items

Is your feature request related to a problem? Please describe. No

Describe the solution you'd like Would love the ability to set a color reference zone. For example, the side of the house, or the white trim around a window. Essentially, a region that should be used to modify the values to account for lighting conditions. When the reference zone is created, the colors in the zone would be averaged, stored permanently and used as a reference to determine lighting conditions for the image in future detections. Suggest a minimum of 25 pixels for this area. They could even just be individual pixels from parts of the image that won't be used for object detection.

For example, if your reference zone averages to rgb(117, 128, 131) when created, it would be checked again before object detection is processed. If it now averages to rgb(129, 127, 122), each channel in the object detection zone would be multiplied by some constant to normalize the colors - in this case the constants would be rgb(0.907,1.008,1.074).

Another thing to note is that colors should be normalized when saving the color variant for an object.

Describe alternatives you've considered Maybe implementing this myself? But I'd need at least the ability to template the colors of variants and am not sure if that's possible without having to constantly reload the configuration.

Additional context I literally haven't even implemented this integration yet 😃, so take this with a grain of salt. Just something I considered while reading the docs.