Let GPT-4o look at every image in your object detection dataset and check against up to three validation prompts you provide. If images are not compliant they will be disabled and reasoning will be put into the metadata. The block passes each image's bounding boxes and labels to GPT-4o so you can for example check if "The bounding boxes and labels do not correspond to to the objects in the image" among other things.
You must pass an OPENAI API key either in the field below or via a secret which you can add from the Custom Blocks->Transformation page in your org with the name OPENAI_API_KEY.
-
Go to an Enterprise project, upload an Object Detection dataset which you wish to validatae
-
Choose Data acquisition->Data Sources->Add new data source.
-
Select Transformation Block and the 'Validate Object Detection Datasets Using GPT-4o' block, fill in your prompts and and run the block.
You need an OPENAI API Key to run the GPT4o model
-
Any items which are invalid will be disabled. Reasoning will be provided in the metadata for each data item
You can modify this repository and push it as a new custom transformation block.
-
Install the Edge Impulse CLI.
-
Open a command prompt or terminal, and navigate to this folder.
-
Create a new transformation block:
$ edge-impulse-blocks init ? Choose a type of block: Transformation block ? Choose an option: Create a new block ? Enter the name of your block: Custom Validate Object Detection Datasets Using GPT-4o ? Enter the description of your block: Use GPT4o to validate a dataset ? What type of data does this block operate on? Standalone (runs the container, but no files / data items passed in) ? Which buckets do you want to mount into this block (will be mounted under /mnt/s3fs/BUCKET_NAME, you can change these mount points in the St udio)? ? Would you like to download and load the example repository? no -
Push the block:
$ edge-impulse-blocks push