Managing your data with Fluid Topics FT 102 26.08.2014 Copyright © Antidot 2014

Managing your data with Fluid Topics

FT 102

26.08.2014Copyright © Antidot 2014

2

Back-Office #2: Detailed Advanced Apps


Cop

yri

gh

t ©

An

tid

ot

20

14

3

Back-Office – Dataflow


Cop

yri

gh

t ©

An

tid

ot

20

14

4

Dataflow

■FTManager■Preprocessor (optional) ■Topic (Search Page and Reader)■Add or remove content

Cop

yri

gh

t ©

An

tid

ot

20

14

5

Dataflow – Sending data■Incremental vs Full

processing

Cop

yri

gh

t ©

An

tid

ot

20

14

6

Dataflow – Sending data■Files structuration:

one whole book VS fragment into smaller books

Cop

yri

gh

t ©

An

tid

ot

20

14

Ditamap A

Ditamap B

Ditamap C

Ditamap D

topicRef

topicRef

topicRef

topicRef

topicRef

topicRef

Ditamap B

topicRef

topicRef

Ditamap C

Ditamap D

topicRef

topicRef

topicRef

topicRef

7

Dataflow – Sending data

■Use the “choose file” button■Choose your upload type

■ In case of doubt, keep “incremental”

■Click on the play button

Cop

yri

gh

t ©

An

tid

ot

20

14

8

Cop

yri

gh

t ©

An

tid

ot

20

15


■Upload web servicecurl -H Expect: --form file="@${FILE}" http://${HOST}/bo-ws/service/${SERVICE_ID}/instance/${STATUS}/paf/${PAF_NAME}/upload?type=${TYPE}&afs:login=${LOGIN}

${FILE}: Archive to be uploaded${HOST}: Back-Office host${SERVICE_ID}: Customer service id${STATUS}: Customer service instance ${PAF_NAME}: Processing pipeline to be used${TYPE}: Processing mode, INCR (default) or FULL${LOGIN}: Login credentials

9

Cop

yri

gh

t ©

An

tid

ot

20

15


■Upload web servicecurl -H Expect: --form file="@${FILE}" http://${HOST}/bo-ws/service/${SERVICE_ID}/instance/${STATUS}/paf/${PAF_NAME}/upload?type=${TYPE}&afs:login=${LOGIN}

${FILE}: Archive to be uploaded${HOST}: Back-Office host${SERVICE_ID}: Customer service id${STATUS}: Customer service instance ${PAF_NAME}: Processing pipeline to be used${TYPE}: Processing mode, INCR (default) or FULL${LOGIN}: Login credentials

10

Dataflow

■LegacyPublications■Allows to add attachments to online

structured publications (such as PDF, Zip, Mov…)

■A mapping file must be used

Cop

yri

gh

t ©

An

tid

ot

20

14

11

Dataflow

■Topic■Receive content from FTManager■Process Topic/Ditamap/Ditaval

Cop

yri

gh

t ©

An

tid

ot

20

14

12

Dataflow

■Unstructured documents■Allows to upload UD

(pdf, word, powerpoint, etc.) intended to be indexed

Cop

yri

gh

t ©

An

tid

ot

20

14

■A UD Control File can be used to:

■Add metadata, facets■Add title and description ■…

13

Dataflow

■Unstructured documents – Control file■Different from Dita Control File

■XSD: http://ref.fluidtopics.com/v2/controlFile.xsd

Cop

yri

gh

t ©

An

tid

ot

20

14

UD1

UD2

UD3

14

Dataflow – Deletion

■Deleting files – Ditamaps ■Relies on Dita control file

■XSD: http://ref.fluidtopics.com/v2/ditaControlFile.xsd

Cop

yri

gh

t ©

An

tid

ot

20

14

http://ref.fluidtopics.com/v2/ditaControlFile.xsd





15

Dataflow – Deletion

■Deleting files – Topics ■Send the map again by removing topicref to

the topic(s) to be deleted

Cop

yri

gh

t ©

An

tid

ot

20

14

16

Dataflow – Uris

■Documents (topic/map) uris■Determined by maps and topics organization

within zip archive, before the first full process.

■Automatically maintained by FT.

■Any change of map and topics organization before each export lead to uris modification.C

op

yri

gh

t ©

An

tid

ot

20

14

17

Dataflow – Uris

■Build a book uri■ …/book#!book;uri=${book_uri}

■Build a topic uri■cannot be directly accessed ■need to be put within a book context.

■ …/book#!book;uri=${uri};breadcrumb=${breadcrumb}

Cop

yri

gh

t ©

An

tid

ot

20

14

18

Cop

yri

gh

t ©

An

tid

ot

20

15

Dataflow – Uris■URL Building for DITA Resources

■Book■No ditaval

– book_uri = md5sum(map_file_path_inside_uploaded_archive)

■At least one ditaval– book_uri = md5sum(md5sum(map_file_path_inside_uploaded_archive)-

md5sum(ditaval_file_path_inside_uploaded_archive))

Ditamap C

topicRef

topicRef

topicRef

book_uri Ditamap C

topicRef

topicRef

topicRef

book_uri w/ditaval

ditaval

19

Cop

yri

gh

t ©

An

tid

ot

20

15

Dataflow – Uris■URL Building for DITA Resources

■Topics■ breadcrumb = md5_topic_level_1-md5_topic_level_2-…-md5_topic_level_N

Ditamap C

topicRef

topicRef

topicRef

topicRef

topicRef

topicRef

Ditamap C

topicRef

topicRef

topicRef

topicRef

topicRef

topicRef

book_uribreadcrumb

20

Dataflow – Troubleshooting

■FTManager ■If FTManager Fails

■Check Status of Topic Pipeline■Read logs■More info in the online documentation

Cop

yri

gh

t ©

An

tid

ot

20

14

21

Dataflow – Troubleshooting

■Processing reports■Dataflow > Topic >

Document Inspector

■urn:meta:inventory■urn:meta:ditaval_report■urn:meta:indexing_report

Cop

yri

gh

t ©

An

tid

ot

20

14

ft uri original uri

■urn:meta:input_report

22

Back-Office – Vocabularies


Cop

yri

gh

t ©

An

tid

ot

20

14

23

Vocabularies

■FT takes full benefits from vocabularies and their structure all along the indexing process:■thesauri,■reference lists, ■taxonomies, ■ontologies■…

■Semantic expansion approach. ■Widening users' searches.

Cop

yri

gh

t ©

An

tid

ot

20

14

24

Vocabularies – PrincipleC

op

yri

gh

t ©

An

tid

ot

20

14

25

Vocabularies

■3 kinds of vocabularies can be created■Synonyms■Taxonomy■Thesaurus

Cop

yri

gh

t ©

An

tid

ot

20

14

26

Vocabularies

■Synonyms■Two uses

■Stemming (stem)– tax = taxes

– royalty = royalties

– manager = managers

■Enrichment (synonyms)– tax = fee, royalty

– duty-free = tax-free, untaxed

– manager = director

Cop

yri

gh

t ©

An

tid

ot

20

14

27

Vocabularies

■Taxonomy

Cop

yri

gh

t ©

An

tid

ot

20

14

devices

computer laptop = netbook

printer

tablets

ipad air

galaxy note

ms surface

smartphones = phones

iphone 6 plus

galaxy S4

nexus4

28

Vocabularies

■Thesaurus SKOS*■“Taxonomy–like” + SKOS standard

specifications

Cop

yri

gh

t ©

An

tid

ot

20

14

* http://www.w3.org/2004/02/skos/

http://www.w3.org/2004/02/skos/



29

Back-Office – DatacenterManaging your data with Fluid Topics

Cop

yri

gh

t ©

An

tid

ot

20

14

30

Datacenter

■Monitor all servers and services

■Access to global Analytics

■Access to system applications:■Scheduler top■PaF Manager top■Update Manager top

Cop

yri

gh

t ©

An

tid

ot

20

14

31

Back-Office – Administration


Cop

yri

gh

t ©

An

tid

ot

20

14

32

Administration

■Manage:■Users■Groups■Access rights■Companies■Services■Instances

Cop

yri

gh

t ©

An

tid

ot

20

14

33

Administration – User Rights ManagementC

op

yri

gh

t ©

An

tid

ot

20

14

34

Cop

yri

gh

t ©

An

tid

ot

20

15

Administration – User Rights Management

■Different rights according to users’ profiles

■Choose applications access rights

■Examples■Launch Data Process (Pipelines)■Edit Vocabularies / Promotes / …

35

Cop

yri

gh

t ©

An

tid

ot

20

15


■Several dimensions■Users : Antidot root user VS other users■Actions / apps (edit, create, publish, etc.)■Rights (read, write, manage)■Roles (developer, expert, etc.)■Admin rights (account manager, admin)

■Many possible combinations !

36

Cop

yri

gh

t ©

An

tid

ot

20

15


■Apps / action■Enable apps visibility with apps permissions

37

Cop

yri

gh

t ©

An

tid

ot

20

15


■Apps & actions / user■Modify users

role and rights

Select user

Modify user

user rightsuser roles

38

User Rights Management

APP Action READ WRITE MANAGEMANAGE w/ role

MANAGE w/ role

developer

MANAGE w/ role expert

DATAFLOW See a Pipeline (PaF) x x x x x x

Run Pipeline (except stable instance)

x x x

Run Pipeline of stable instance

x

Use Document Inspector

x x x x x x

Cop

yri

gh

t ©

An

tid

ot

20

14

RIGHTS

39


MANAGE w/ role

developer


ANALYTICS Use the app x x x x x x

Open view editor x x x x

VIEWS Create / edit / delete x x x x

Cop

yri

gh

t ©

An

tid

ot

20

14


RIGHTS

40


MANAGE w/ role

developer


PROMOTE Create new / duplicate x x x x x

Edit campaign / replies x x x x x

Suspend x x x x x

Save x x x x x

Cop

yri

gh

t ©

An

tid

ot

20

14


RIGHTS

41


MANAGE w/ role

developer


VOCABULARIES Download x x x x x x

Create new x x x x x

Edit entry x x x x x

Save x x x x x

Publish x x x x xCop

yri

gh

t ©

An

tid

ot

20

14


RIGHTS

42


MANAGE w/ role

developer


CONFIGURATION Read conf values x x x x x x

Edit technical conf values

x * x x

Edit logical conf (PaF Architect)

x x

Upload a file in File Repository

x x

Publish configuration x x x

Cop

yri

gh

t ©

An

tid

ot

20

14


RIGHTS

* : not necessarily all the values, depends on the user’s role

43

APP ActionNone Company

MgrAccount Mgr

of none project

Account Mgr of the

project

Admin and "antidot" root user

ADMINISTRATION Access the app x x x x

Manage bots x

Create / edit organization

x x x

Create project x x x

Create service / instance

x x

Edit project x x

Edit service/instance x x

Cop

yri

gh

t ©

An

tid

ot

20

14

User Rights ManagementLEVEL

44


MgrAccount Mgr

of none project

Account Mgr of the

project


ADMINISTRATION Delete project x x

Delete service/instance

x x

Create user x x

Create group x x x

Edit user x x x

Edit group x x x

Delete user x x x

Delete group x x x

Cop

yri

gh

t ©

An

tid

ot

20

14


45


MgrAccount Mgr

of none project

Account Mgr of the

project


ADMINISTRATION Add user to a group x x x

Handle user rights x x x

Handle group rights x x x

Handle user roles x

Promote user Company Manager

x x x

Promote user Account Manager

x

Promote user Admin x

Cop

yri

gh

t ©

An

tid

ot

20

14


46


■Examples■“I need to let Mrs. Lin GUIST access to

Vocabularies app, and allow her to edit the different kind of vocabularies. I wish to forbid her the access to Configuration, and Promote apps”

■“I want to give an access to Mr. Mark ETING to the Analytics, Dashboard, etc. with manage possibilities, but without having access to Vocabularies”.

Cop

yri

gh

t ©

An

tid

ot

20

14

47




■“I want to give an access to Mr. Mark ETING to the Analytics, Dashboard, etc. with manage possibilities, but without having access to Vocabularies”.

Cop

yri

gh

t ©

An

tid

ot

20

14

48




■Apps permissions for the given company: only check the box for the app Vocabularies

■Rights on the instance : Write■Role : None

Cop

yri

gh

t ©

An

tid

ot

20

14

49


■Examples■“I want to give an access to Mr. Mark ETING to

the Analytics, Dashboard, etc. with manage possibilities, but without having an access to Vocabularies”.

■Apps permissions for the given company: All apps’ box checked, except Vocabularies

■Rights on the instance : Manage■Role : Expert

Cop

yri

gh

t ©

An

tid

ot

20

14

50


■Must be known

■Admin user also has MANAGE right

■“Antidot” root user has MANAGE right with expert role

■Only member of host company can be promoted account manager or Admin

Cop

yri

gh

t ©

An

tid

ot

20

14

51

QuestionsManaging your data with Fluid Topics

Cop

yri

gh

t ©

An

tid

ot

20

14