-
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
41 changed files
with
932 additions
and
13 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,4 +1,4 @@ | ||
--- | ||
title: FNBr Database | ||
title: FNBr database | ||
--- | ||
|
||
[[webtool-4.0]] |
Binary file not shown.
Binary file not shown.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
Esta pasta contem os scripts para atualização do banco para a versão 4.0. | ||
|
||
Esta versão é de julho/2024, com os principais objetivos: | ||
|
||
- Reunificar as tabelas usadas nos projetos de multimodalidade. | ||
- Elevar SENTENCE para entity para permitir relacionamentos diversos. | ||
- Criar tabelas que atendam ao processo de tokenização. | ||
- Criar a estrutura para projetos e datasets. | ||
- Criar a estrutura para tarefas do usuário. | ||
- Registrar cada anotação no contexto de um projeto/tarefa. | ||
- Incrementar o uso de views para facilitar as consultas ao banco. | ||
- Criar uma estrutura de mensagens para o usuário. | ||
- Remover tabelas que não estão sendo usadas: Property, Translation, C5Node, C5Link, Form*, Log, Person, SubCorpus, Template, Transaction, WordSegment. | ||
|
||
|
||
- Projetos de Multimodalidade | ||
|
||
. Unificar as estruturas para os tipos de anotação multimodal | ||
. Remover o sufixo MM | ||
. Tabelas para Sentence, Image, Video, Sound | ||
. Objetos visuais (VisualObject) compostode de uma ou mais BoundingBox | ||
|
||
|
||
- Criar uma tabela sentence_translatiopn_temp temporaria, para a reorganização da sentence_translation; |
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,21 @@ | ||
-- | ||
-- script para criação da estrtura default de project | ||
-- para webtool40 | ||
-- | ||
-- Project: Default | ||
-- Dataset: Default | ||
-- Task: Default | ||
|
||
insert into project(name, description) values ('Default Project', 'Default Project'); | ||
insert into dataset(name,description,idProject) values ('Default Dataset', 'Default Dataset', (select idProject from project where name = 'Default Project')); | ||
insert into task(size,isActive,type,createdAt,name,description,idDataset) values | ||
(0,1,'Annotation',now(),'Default Task','Default Task',(select idDataset from dataset where name = 'Default Dataset')); | ||
|
||
-- associa todos os corpus existentes ao Dataset Default, até que sejam criados os projetos corretos. | ||
|
||
select idDataset into @idDataset from dataset where name = 'Default Dataset'; | ||
update corpus set idDataset = @idDataset where idCorpus > 0; | ||
delete from dataset_corpus where idCorpus > 0; | ||
insert into dataset_corpus (idDataset, idCorpus) | ||
select idDataset,idCorpus from corpus; | ||
|
297 changes: 297 additions & 0 deletions
297
content/models/webtool/migration_project_update_4.01.txt
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,26 @@ | ||
insert into qualiarelation(name,direct,inverse) values ('Causation','causes','caused_by'); | ||
insert into qualiarelation(name,direct,inverse) values ('Action','acts_on','object_of'); | ||
insert into qualiarelation(name,direct,inverse) values ('Result','results','result_from'); | ||
insert into qualiarelation(name,direct,inverse) values ('Affect','affects','affected_by'); | ||
insert into qualiarelation(name,direct,inverse) values ('Creation','creates','created_by'); | ||
insert into qualiarelation(name,direct,inverse) values ('Transfer','transfers','transfered_by'); | ||
insert into qualiarelation(name,direct,inverse) values ('Use','uses','used_by'); | ||
insert into qualiarelation(name,direct,inverse) values ('Membership','member_of','has_member'); | ||
insert into qualiarelation(name,direct,inverse) values ('Activity','activity_of','has_actor'); | ||
insert into qualiarelation(name,direct,inverse) values ('Quality','quality_of','has_quality'); | ||
insert into qualiarelation(name,direct,inverse) values ('Containment','contains','contained_in'); | ||
insert into qualiarelation(name,direct,inverse) values ('Part_whole','part_of','has_part'); | ||
insert into qualiarelation(name,direct,inverse) values ('Location','location_of','located_in'); | ||
insert into qualiarelation(name,direct,inverse) values ('Inclusion','includes','included_at'); | ||
insert into qualiarelation(name,direct,inverse) values ('Material','material_of','has_material'); | ||
insert into qualiarelation(name,direct,inverse) values ('Relation','related_to','related_to'); | ||
insert into qualiarelation(name,direct,inverse) values ('Origin','origin_of','has_origin'); | ||
insert into qualiarelation(name,direct,inverse) values ('Production','produces','product_of'); | ||
insert into qualiarelation(name,direct,inverse) values ('Feeling','feels','feeling_of'); | ||
insert into qualiarelation(name,direct,inverse) values ('Use_as','used_as','use_of'); | ||
insert into qualiarelation(name,direct,inverse) values ('Use_against','used_againsts','telic_of'); | ||
insert into qualiarelation(name,direct,inverse) values ('Use_for','used_for','telic_of'); | ||
insert into qualiarelation(name,direct,inverse) values ('Change_to','changes_to','changes_from'); | ||
insert into qualiarelation(name,direct,inverse) values ('Change_from','changes_from','changes_to'); | ||
insert into qualiarelation(name,direct,inverse) values ('Type','type_of','has_type'); | ||
insert into qualiarelation(name,direct,inverse) values ('Exemplar','exemplar_of','has_exemplar'); |
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,102 @@ | ||
# webtool-4.0 | ||
|
||
|
||
## Nova estrutura para projetos | ||
|
||
- Tabelas: Project, Dataset, Task, UserTask | ||
|
||
### Tabela AnnotationObject | ||
|
||
- todos os objetos que podem ser anotados | ||
- equivale ao ENTITY para as tabelas da estrutura | ||
- tipos de objetos: | ||
|
||
- SEN Sentence | ||
- SOB Static Object | ||
- DOB Dynamic Object | ||
- TXS Text Span | ||
- IMG Image | ||
- DOC Document | ||
- VID Video | ||
- BBX BoundingBox | ||
|
||
|
||
### Tabelas de Objetos | ||
|
||
- boundingbox: usado nas anotaçãoes estática e dinâmica | ||
- dynamicobject: Usado na anotação dinâmica; um DynamicObject pode ter várias BBoxes | ||
- staticobject: Usado na anotação dinâmica; equivale às Entities do Flickr30k; pode ter várias BBoxes | ||
- video: informações sobre os videos da anotação dinâmica | ||
- image: informações sobre as imagens (atualmente apenas do Flickr30k) | ||
- token: texto (token) e posição do token em uma sentença | ||
- sentence: texto de uma sentença (associada a um ou mais documentos) | ||
- textspan: startchar/endchar (substitui o label na notação de texto); usado também na anotação estática | ||
- timespan: startTime/endTime usados na anotação dinâmica | ||
- document: documentos (associados a sentenças) | ||
|
||
### Relações entre objetos | ||
|
||
- as relações entre objetos são registradas na tabela AnnotationObjectRelation | ||
|
||
- rel_translation: sentence/sentence | ||
- rel_description: image/sentence | ||
- rel_video_sentence: video/sentence | ||
- rel_video_dynobj: video/dynamicobject | ||
- rel_image_staobj: image/staticobject | ||
- rel_image_sentence: image/sentence | ||
- rel_dynobj_bbox: dynamicobject/boundingbox | ||
- rel_staobj_bbox: staticobject/boundingbox | ||
- rel_sentence_time: sentence/timespan - anotação dinâmica | ||
- rel_sentence_textspan: sentence/textspan - anotação estática | ||
- rel_textspan_bbox: textspan/boundingbox | ||
- rel_document_sentence: document/sentence | ||
- rel_document_video: document/video | ||
|
||
### Anotação | ||
|
||
- uma anotação é a relação entre um AnnotationObject e uma Entity, no contexto de uma UserTask | ||
- relationtype: rel_annotation | ||
|
||
## Atualização de Entity.type para 3 chars | ||
|
||
- AST AnnotationStatus (tabela TypeInstance) | ||
- C5 C5 | ||
- CE Construction Element | ||
- CON Constraint | ||
- CPT Concept | ||
- CRP Corpus | ||
- CTY Core Type | ||
- CXN Construction | ||
- DOC Document | ||
- FE FrameElement | ||
- FRM Frame | ||
- GLB GenericLabel | ||
- GEN Genre | ||
- GTY GenreType | ||
- ITY Instantiation Type | ||
- LEM Lemma | ||
- LTY LayerType | ||
- LU LU | ||
- LEX Lexeme | ||
- CNT Constraint Type | ||
- POS POS | ||
- CTY Concept Type | ||
- QLA Qualia | ||
- QLR Qualia relation | ||
- RTG Relation Group | ||
- RTY Relation Type | ||
- STY Semantic Type | ||
- TYP Type | ||
- UDF UD Feature | ||
- UDP UD POS | ||
- UDR UD Relation | ||
- WFM WordForm | ||
|
||
### Novos tipos | ||
|
||
- PRJ Project | ||
- DTS Dataset | ||
- TSK Task | ||
|
||
|
||
|
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters