DANE

Utils for working with the Distributed Annotation and Enrichment system

Tool suite: DANE

The following closely related tools are in a tool suite together with DANE:

  • Experimental: The technology is implemented and ready for experimental settings (beta), but requires further work and validation.
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.

DANE-server 0.3.1

Back-end for the Distributed Annotation 'n' Enrichment (DANE) system [view more]
Created: 2020-01-22
Modified: 2023-06-19
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.

dane-asr-worker 0.1.0

  •   Nanne van Noord
  •   Jaap Blom
Automatic speech recognition through an external service. Depends on DANE-server [view more]
  • Multimedia processing
Created: 2022-02-15
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.

dane-download-worker 0.9.0

  •   Nanne van Noord
  •   Jaap Blom
Basic "DANE worker" that downloads input data via HTTP(s) URLs for further processing by other DANE workers. Depends on DANE-server [view more]
  • Multimedia processing
Created: 2022-02-08
  • Software Library
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.

dane-workflows 0.9.0

  •   Jaap Blom
  •  
  •   The Netherlands Institute for Sound and Vision
Python library for setting up simple data processing workflows (using DANE) [view more]
  • Multimedia processing
Created: 2022-07-18

Citation

You can cite this software using the following citation generated from its metadata:

Logs & Reviews

Name
Automatic software metadata validation report for DANE 0.4.3
Author
  • codemetapy validator using software.ttl
Date
2024-11-02 03:05:03
Review
Please consult the CLARIAH Software Metadata Requirements at https://github.com/CLARIAH/clariah-plus/blob/main/requirements/software-metadata-requirements.md for an in-depth explanation of any found problems

Validation of DANE 0.4.3 was successful (score=4/5), but there are some remarks which you may or may not want to address:

1. Info: Software source code *SHOULD* link to a continuous integration service that builds the software and runs the software's tests (This is missing in the metadata)
2. Info: An interface type *SHOULD* be expressed: Software source code should define one or more target products that are the resulting software applications offering specific interfaces (This is missing in the metadata)
3. Info: Reference publications *SHOULD* be expressed, if any (This is missing in the metadata)
4. Info: The funder *SHOULD* be acknowledged (This is missing in the metadata)
5. Info: A research domain *SHOULD* be expressed as a category using the NWO Research Fields vocabulary, if applicable (This is missing in the metadata)
6. Info: A research activity *SHOULD* be expressed as a category using the TaDiRaH vocabulary (This is missing in the metadata)
Rating
★ ★ ★ ★ ☆
(log file starts at Sat Nov  2 03:04:52 UTC 2024)

[harvester info] --> Processing dane (https://github.com/CLARIAH/DANE) [Sat Nov  2 03:04:52 UTC 2024]

[harvester info] Git updating cached clone of https://github.com/CLARIAH/DANE...

[harvester info] No releases found, falling back to default git branch!

[harvester info] Using 'main'

[harvester info] Git reference: main

[harvester info] Scanning directory /tmp/codemeta-harvester.cache/dane for harvestable resources...

[harvester info] found python setup for dane, converting to codemeta

[harvester info] Looking for license....

[harvester info] Found license Apache-2.0

[harvester info] Getting contributors from git...

[harvester info] No git contributors found

[harvester info] Getting top contributor from git...

[harvester info] Git top contributor  will be assigned as author (and maintainer) if none are found in the metadata

[harvester info] Extracting last and first commit date from git log....

[harvester info] Date created: 2019-11-25T15:36:57Z+0100, date modified: 2024-05-13T10:13:48Z+0200

[harvester info] Querying Github/GitLab API (https://github.com/CLARIAH/DANE)

[harvester info] Adding URL for found README: README.md

[harvester info] Looking for TRL information in README.md...

[harvester info] Looking for repostatus information in README.md...

[harvester info] Looking for continuous integration information in README.md...

[harvester info] Looking for documentation links in README.md...

[harvester info] Scraping title from https://dane.readthedocs.io/en/latest/intro.html#configuration

[harvester info] Found documentation at https://dane.readthedocs.io/en/latest/intro.html#configuration : "name": "Introduction — DANE  documentation",

[harvester info] Inferring repostatus information from git activity (used only as a fallback if not explicitly provided)...

[harvester info] Inferred repostatus https://www.repostatus.org/#active

[harvester info] Setting group DANE

[harvester info] Reconciliating: codemetapy  --baseuri https://tools.dev.clariah.nl --baseuri https://tools.dev.clariah.nl --includecontext --addcontext https://w3id.org/nwo-research-fields --addcontext https://w3id.org/research-technology-readiness-levels --addcontextgraph https://vocabs.dariah.eu/rest/v1/tadirah/data?format=text/turtle --trl --identifier "dane" --codeRepository "https://github.com/CLARIAH/DANE" --validate /etc/software.ttl --enrich --textv "Please consult the CLARIAH Software Metadata Requirements at https://github.com/CLARIAH/clariah-plus/blob/main/requirements/software-metadata-requirements.md for an in-depth explanation of any found problems" -O /tmp/out/dane.codemeta.json /tmp/codemeta-harvester.cache//tmp/99-repostatus.dane.codemeta.json /tmp/codemeta-harvester.cache//tmp/90-authors.dane.codemeta.json /tmp/codemeta-harvester.cache//tmp/50-documentation.dane.codemeta.json /tmp/codemeta-harvester.cache//tmp/41-readme.dane.codemeta.json /tmp/codemeta-harvester.cache//tmp/40-gitapi.dane.codemeta.json /tmp/codemeta-harvester.cache//tmp/39-gitdate.dane.codemeta.json /tmp/codemeta-harvester.cache//tmp/29-license.dane.codemeta.json /tmp/codemeta-harvester.cache//tmp/20-python.dane.codemeta.json /tmp/codemeta-harvester.cache//tmp/04-applicationSuite.dane.codemeta.json 

-- begin log --

Passed 9 files/sources but specified 0 input types! Automatically guessing types...

Detected input types: [('/tmp/codemeta-harvester.cache//tmp/99-repostatus.dane.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/90-authors.dane.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/50-documentation.dane.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/41-readme.dane.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/40-gitapi.dane.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/39-gitdate.dane.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/29-license.dane.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/20-python.dane.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/04-applicationSuite.dane.codemeta.json', 'json')]

Adding to contextgraph: /tmp/turtle

Initial URI automatically generated, may be overriden later: https://tools.dev.clariah.nl/dane

Processing source #1 of 9

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/99-repostatus.dane.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.dev.clariah.nl/dane

[CODEMETA COMPOSITION (https://tools.dev.clariah.nl/dane)] processed 1 new triples, total is now 2

Processing source #2 of 9

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/90-authors.dane.codemeta.json

    Found main resource with URI https://tools.dev.clariah.nl/dane.topcontributor/snapshot

    Injected (possibly temporary) URI https://tools.dev.clariah.nl/dane

[CODEMETA COMPOSITION (https://tools.dev.clariah.nl/dane)] processed 1 new triples, total is now 2

Processing source #3 of 9

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/50-documentation.dane.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.dev.clariah.nl/dane

[CODEMETA COMPOSITION (https://tools.dev.clariah.nl/dane)] processed 4 new triples, total is now 6

Processing source #4 of 9

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/41-readme.dane.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.dev.clariah.nl/dane

[CODEMETA COMPOSITION (https://tools.dev.clariah.nl/dane)] processed 1 new triples, total is now 7

Processing source #5 of 9

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/40-gitapi.dane.codemeta.json

    Found main resource with URI https://tools.dev.clariah.nl/dane/snapshot

    Injected (possibly temporary) URI https://tools.dev.clariah.nl/dane

[CODEMETA COMPOSITION (https://tools.dev.clariah.nl/dane)] processed 14 new triples, total is now 20

Processing source #6 of 9

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/39-gitdate.dane.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.dev.clariah.nl/dane

[CODEMETA COMPOSITION (https://tools.dev.clariah.nl/dane)] overriding old http://schema.org/dateCreated (2019-11-25T14:28:24Z -> 2019-11-25T15:36:57Z+0100)

[CODEMETA COMPOSITION (https://tools.dev.clariah.nl/dane)] overriding old http://schema.org/dateModified (2024-08-02T06:46:26Z -> 2024-05-13T10:13:48Z+0200)

[CODEMETA COMPOSITION (https://tools.dev.clariah.nl/dane)] processed 2 new triples, total is now 20

Processing source #7 of 9

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/29-license.dane.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.dev.clariah.nl/dane

[CODEMETA COMPOSITION (https://tools.dev.clariah.nl/dane)] overriding old http://schema.org/license (http://spdx.org/licenses/Apache-2.0 -> Apache-2.0)

[CODEMETA CORRECTION (https://tools.dev.clariah.nl/dane)] automatically converting license to spdx URI

[CODEMETA COMPOSITION (https://tools.dev.clariah.nl/dane)] processed 1 new triples, total is now 20

Processing source #8 of 9

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/20-python.dane.codemeta.json

    Found main resource with URI https://tools.dev.clariah.nl/dane/0.4.3

    Injected (possibly temporary) URI https://tools.dev.clariah.nl/dane

[CODEMETA COMPOSITION (dane)] overriding old http://schema.org/description (Utils for working with the Distributed Annotation 'n' Enrichment (DANE) system -> Utils for working with the Distributed Annotation and Enrichment system)

[CODEMETA COMPOSITION (dane)] overriding old https://codemeta.github.io/terms/developmentStatus (https://www.repostatus.org/#active -> https://www.repostatus.org/#wip)

[CODEMETA COMPOSITION (dane)] processed 90 new triples, total is now 103

Processing source #9 of 9

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/04-applicationSuite.dane.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.dev.clariah.nl/dane

[CODEMETA COMPOSITION (dane)] processed 1 new triples, total is now 104

Remapping URI to (possibly) new identifier and version component: https://tools.dev.clariah.nl/dane -> https://tools.dev.clariah.nl/dane/0.4.3

[CODEMETA VALIDATION (dane)] done

[CODEMETA ENRICHMENT (dane)] automatically adding programmingLanguage Python derived from runtimePlatform Python

[CODEMETA ENRICHMENT (dane)] adding author https://tools.dev.clariah.nl/person/jblom as contributor

[CODEMETA ENRICHMENT (dane)] adding author https://tools.dev.clariah.nl/person/nanne-van-noord as contributor

[CODEMETA ENRICHMENT (dane)] considering first author as maintainer

VALIDATION https://tools.dev.clariah.nl/dane/0.4.3 #1: Info: Software source code *SHOULD* link to a continuous integration service that builds the software and runs the software's tests (This is missing in the metadata)

VALIDATION https://tools.dev.clariah.nl/dane/0.4.3 #2: Info: An interface type *SHOULD* be expressed: Software source code should define one or more target products that are the resulting software applications offering specific interfaces (This is missing in the metadata)

VALIDATION https://tools.dev.clariah.nl/dane/0.4.3 #3: Info: Reference publications *SHOULD* be expressed, if any (This is missing in the metadata)

VALIDATION https://tools.dev.clariah.nl/dane/0.4.3 #4: Info: The funder *SHOULD* be acknowledged (This is missing in the metadata)

VALIDATION https://tools.dev.clariah.nl/dane/0.4.3 #5: Info: A research domain *SHOULD* be expressed as a category using the NWO Research Fields vocabulary, if applicable (This is missing in the metadata)

VALIDATION https://tools.dev.clariah.nl/dane/0.4.3 #6: Info: A research activity *SHOULD* be expressed as a category using the TaDiRaH vocabulary (This is missing in the metadata)

-- end log --

[harvester info] Output written to /tmp/out/dane.codemeta.json

[harvester info] <-- Finished processing dane (https://github.com/CLARIAH/DANE) [Sat Nov  2 03:05:03 UTC 2024]

        

Metadata Properties

Version
0.4.3
Interface types
  • Unknown
Software website
Source code repository
 https://github.com/CLARIAH/DANE  Stars are an indicator of the popularity of this project on GitHub
Category
  • Multimedia > Video
  • Scientific/Engineering > Artificial Intelligence
  • Software Development > Libraries > Python Modules
Development Status
  • Experimental: The technology is implemented and ready for experimental settings (beta), but requires further work and validation.
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.
Issue Tracker (Support)
https://github.com/CLARIAH/DANE/issues  The number of open issues on the issue tracker  The number of closes issues on the issue tracker
Documentation
License
Author(s)
Maintainer(s)
Contributor(s)
Producer
Programming Language
  • Python
Runtime Platform
  • Python 3
Software dependencies
  • boto3
  • elasticsearch7
  • pika
  • python
  • requests
  • urllib3
  • yacs
Metadata validation
★ ★ ★ ★ ☆
Created
2019-11-25 15:36:57 +0100
Last modified
2024-05-13 10:13:48 +0200  Last commit (main branch). Gives an indication of project development activity and rough indication of how up-to-date the latest release is.  Number of commits since the last release. Gives an indication of project development activity and rough indication of how up-to-date the latest release is.