Tuesday, July 2, 2013

Franz Tech Corner - July 2013



Franz Tech Corner News
July, 2013

In this issue

Tech Corner Article: Sized queues in multiprocessing
queue
Queues are CLOS objects which assist programmers using multiprocessing in scheduling access to data, in order to avoid inconsistent actions on the data by concurrently running threads.
As implemented, queues do not have maximum sizes, and this has the potential of allowing queues to grow beyond available memory. In this article, we describe how to optimize queues for robust application development.

For the full article, see heretarget blank image..

Audio recordings etc. from the European Lisp Symposium (ELS'13) - Madrid, June
ELS 2013
The purpose of the European Lisp Symposium is to provide a forum for the discussion and dissemination of all aspects of design, implementation and application of any of the Lisp and Lisp-inspired dialects, including Common Lisp, Scheme, Emacs Lisp, AutoLisp, ISLISP, Dylan, Clojure, ACL2, ECMAScript, Racket, SKILL, Hop and so on.
The main theme of the 2013 European Lisp Symposium was on the use of these languages with respect to the current grand challenges: big tables, open data, semantic web, network programming, discovery, robustness, runtime failures, etc.
The audio tracks for most of the sessions were recorded and are now available for download heretarget blank image..

Free Webcast: Semantically Augmenting Hadoop with GeoTemporal Reasoning and Social Networking Analytics
Hadoop with RDF Quad Logo

Thursday, July 11 - 10:00 AM Pacific

E-commerce sites, auction sites, financial institutions, insurance companies and telephone companies all have event based data that describes transactions between customers (Social Networks) that are located in time and space (GeoTemporal).
All these transactions together form interesting social graphs and patterns of customer behavior. Some of these behaviors are very interesting from a marketing perspective, other behaviors might point to fraudulent actions. Analyzing graphs and geospatial oriented data is notoriously hard to do with typical big data solutions, such as Hadoop, so we use a hyper scalable graph database to do this analysis.
We will present a number of new technologies to make it very straightforward and user friendly to analyze behavioral patterns. We discuss extending SPARQL 1.1 with a large number of magic predicates for geospatial, temporal and social network analysis so that non-specialists can very easily build very powerful queries. We will present new visual discovery capabilities to GRUFF, a graphical user interface for Graph Search. We will demonstrate how users can explore visual graphs and easily turn interesting patterns into SPARQL queries.
To register for this webinar, see https://www2.gotomeeting.com/register/914686634target blank image.

Free Webcast: Real-Time Graph Search for Corporate Risk Mitigation
Jans Aasman

Thursday, July 25 - 10:00 AM Pacific

The management of partner relationships and the associated legal agreements for large projects continues to escalate in complexity. Currently, legal/risk experts have no tools to detect, monitor and manage risk that match this exploding complexity, velocity and data.
For example, contracts utilized for infrastructure construction represent some of the most complex of contracts and carries with them the successful creation of a bridge or a new multi-story building. With sub-contractors in the hundreds and the associated contracts to define how the project will be constructed in the 1000s of pages, the ability of a project manager to constantly be aware of impending risks, defaults, substantial potential litigation and damages has become virtually unmanageable.
Decomposing these complex relationships, via graph technologies, into discrete components and linking these components to relevant content, inside and outside of a corporation promises to facilitate real-time automatic calculation of risk, flagging of non-compliance and improve situational monitoring of projects.
In this presentation we discuss the graph based technologies that facilitate the ability to:
  • identify contractual risk in real-time
  • connect the adverse events with contract terms
  • improve process flow and improve on lessons learned
To register for this webinar, see https://www2.gotomeeting.com/register/218829562target blank image.

Free Webcast: Semantic Indexing of Unstructured Documents Using Taxonomies and Ontologies
Smartlogic Franz Logo

Wednesday, August 7 - 10:00 AM Pacific

Life Science and Healthcare organizations use RDF/SKOS/OWL based vocabularies, thesauri, taxonomies and ontologies to organize enterprise knowledge. There are many ways to use these technologies but one that is gaining momentum is to semantically index unstructured documents through ontologies and taxonomies.
In this talk we will demonstrate two projects where we use a combination of SKOS/OWL based taxonomies and ontologies, entity extraction, fast text search, and Graph Search to create a semantic retrieval engine for unstructured documents.
The first project organized all science related artifacts in Malaysia through a taxonomy of scientific concepts. It indexed all papers, people, patents, organizations, research grants, etc, etc, and created a user friendly taxonomy browser to quickly find relevant information, such as, "How much research funding has been spent on a certain subject over the last 3 years and how many patents resulted from this research".
The second project discusses a large socio-economic content publisher that has millions of documents in at least eight different languages. Reusing documents for new publications was a painful process given that keyword search and LSI techniques were mostly inadequate to find the document fragments that were needed. Fortunately the organization had begun developing a large SKOS based taxonomy that linked common concepts to various preferential and alternative labels in many languages. We used this taxonomy to index millions of document fragments and we'll show how we can perform relevancy search and retrieval based on taxonomic concepts.
To register for this webinar, see https://www2.gotomeeting.com/register/224042738target blank image.

2013 NoSQL Now! - Aug. 20-22, San Jose. Franz's Talk - Tracking Moving Objects in a Graph Database
NoSQL 2013
The third annual NoSQL Now! Conference is the largest vendor-neutral forum focused on NoSQL (Not Only SQL) technologies.
Join us for Franz's Presentation - Tracking Moving Objects in a Graph Databasetarget blank image. Wednesday, August 21, 4:15 PM - 5:00 PM
For additional conference information, see heretarget blank image..

New! Gruff Learning Center
gruff lab guy
Gruff is a freely downloadable graphical triple-store browser that attempts to make data retrieval more pleasant and powerful with a variety of tools for laying out cyclical graphs, displaying tables of properties, managing queries, and building queries as visual diagrams.
The Gruff Learning Center offers tutorials and training videos to help accelerate the new user's learning curve.

Visit the Gruff Learning Center heretarget blank image..

Training Schedule
Gruff

LabBECOME ALLEGRO CERTIFIED - To obtain your Allegro CL Certification enroll in our LIVE Program which offers developers an opportunity to learn and improve their Lisp programming skills from the comfort of their home or office while interacting with the Franz instructor.
Lisp Programming Series Level I: Basic Lisp Essentials - September 4, 11, and 18
Lisp Programming Series Level II: Specialized Components of Lisp - October 9, 16, and 23
For additional information and to register, see here.

Wednesday, April 17, 2013

Franz Tech Corner - April 2013




Franz Tech Corner News
April, 2013

In this issue
Free Webcast: Gruff Version 5 - Tips and Tricks to become a Power User
Smartlogic Franz Logo

10:00 AM Pacific, Wednesday, April 24th


The free-form nature of Graph style data offers a lot of flexibility for connecting data, but that freedom can also make it more challenging to find interesting patterns or simply navigate through your data. It has become typical for RDF data sets to contain thousands of classes and relationship types, making it hard to even formulate the analytics and queries you want to perform.
Gruff, a visual analytics and discovery tool, was developed by Franz to specifically address these Graph data challenges in large data sets. Gruff lets you intelligently explore graphs in multiple views:
  • Graphical View - See the shape and density of your graph data
  • Tabular view - Understand objects as a whole
  • Outline view - Explore the often hierarchical nature of graphs
  • Query view - Write Prolog or SPARQL queries
  • Graphical Query Builder - Create queries visually via drag and drop
The new Gruff v5 uniquely offers users a powerful capability to mark an interesting visual pattern in the Graphical View and convert that automatically into a textual SPARQL or Prolog query. This query code generator operating in conjunction with new zoom in - out controls on Gruff's large graph visualization engine provides users with an unmatched graph discovery tool.
Join us for this webcast training session to learn how to:
  • Build SPARQL and Prolog Queries visually
  • Find Similar Patterns with auto generated SPARQL from the Graph View
  • Create and Edit RDF in the graph view
  • Discover new connections in your data
  • View Hierarchies and edit them directly
  • Explore the Linked Open Data Cloud
Gruff, a free tool, is simple to install and provides an easy on-ramp for non-technical users to engage the Semantic Web. Join us for this one hour training session.
To register for this webinar, see https://www2.gotomeeting.com/register/609916178target blank image.

Tech Corner: The importance of regular updating
smp
Updating Allegro CL means getting and applying available patches for your version and platform. Patches are posted when they become available. Several tools included with Allegro CL assist in updating the product. Updates are not automatic, although (unless you turn them off) you may get automatic reminders that an update is suggested.
Updating involves two steps: downloading available patches and rebuilding images. Patches cannot always simply be loaded into a Lisp image, since (among other reasons) modified functions might be compiled inline in the existing image (and thus will not be changed) and modified macros will not replace compiled calls. Using in-Lisp tools to download patches therefore requires (at some point) exiting from Lisp and running a separate program. Or you can run a different program (outside Lisp) which both finds and downloads relevant patches and rebuilds images.
Why update? Updating is recommended unless you have a stable application and no time to verify its stability with the new patches (such as a demo to backers this afternoon). Patches can, of course, introduce problems. This can happen in two ways:
One, the patch can contain an error (and so introduce a bug) or can interact badly with your code (by slowing down some heavily used feature). The patch, by correcting code might cause your code to fail because your code depended on the uncorrected behavior (see the full article for an example).
Number two is particularly dicey for us at Franz and we often delay such changes until releases but sometimes consider the change important enough to release the patch anyway. In those cases, the release notes are always updated to note the behavior change.
So, it is very important to test your application after applying patches. If you have difficulty with a patch, note that you can remove it.
For the full article, see here

European Lisp Symposium (ELS'13) - Madrid - June 1-4
ELS 2013
The main theme of the 2013 European Lisp Symposium is on the use of these languages with respect to the current grand challenges: big tables, open data, semantic web, network programming, discovery, robustness, runtime failures, etc. The European Lisp Symposium 2013 solicits the submission of papers with these specific themes in mind, alongside the more traditional tracks which have appeared in the past editions.
For full conference information and to register, see heretarget blank image..

Gruff v5 - Now Available!
gruff lab guy
New Features include:



  • Gruff has a new spring layout algorithm that it uses for larger visual graphs. It is much faster for larger graphs than the original constraint-based algorithm, though it does not prevent nodes from overlapping links. The new option "Visual Graph Options | Spring Layout Options | Minimum Nodes for Spring Layout" controls when the layout automatically switches between the two algorithms. Other new options on that same child menu control the spring layout behavior.
  • During a spring layout you can press the zero key to toggle animation on and off. That allows letting a large layout run at full speed and then turning animation on to see how far it has progressed.
  • Several new zooming commands on the Layout menu of the graph view provide alternate views of the larger visual graphs that can now be handled by the spring layout algorithm. Node and link labels are not drawn when zoomed out, though they do appear in tooltips. Full mouse and keyboard functionality is still available on zoomed-out nodes and links.
  • The mouse wheel now performs zooming in the graph view, rather than scrolling as before, though the new option "Visual Graph Options | Layout Options | Mouse Wheel Zooms" could be used to revert to the scrolling behavior.
  • The new command "Layout | Update Layout Vigorously" is an incremental layout that is better at untangling crossed chains of nodes.
  • The new option "Visual Graph Options | Layout Options | Maximum Nodes for Animation" avoids animating layouts when there are too many nodes and links for animation to be fast enough for interactive use.
  • Three options on the "Visual Graph Options | Inclusion Options" child menu now have much larger defaults because the new spring layout can handle larger graphs. The new defaults will override any custom values that you may have set. These options are "Number of Total Links for Warning", "Number of Total Links for Abort", and "Number of Links from One Node for Warning".
  • Displaying the results of completed queries is faster.
  • The new option "Query Options | Exclude Orphans from Visual Graphs" controls whether orphan nodes may appear in a visual graph that's generated from a query.
  • Nodes in the graph view can now display pixmaps, if triples are added to the store for that. If the UPI of a node names a pixmap file on the local machine, then the graph view will display the pixmap for the node, rather than a text label. The UPI string can be either an absolute path string or a relative path string that will be merged with "Global Options | Miscellaneous | Document Base Folder" to find the actual file to use.
  • The various commands for loading triples now allow you to select multiple files at once in the file selection dialog (when they're in the same folder).
  • The new spring layout now handles the existing predicate direction constraints, such as forcing all subClassOf links to point upward as in a tree graph.
  • You can now set or clear the layout direcction constraint for a predicate from the pop-up menu in the legend pane, rather than only from the "Visual Graph Options | Layout Options" menu.
  • Highlighted nodes in the visual graph (see Select | Highlight Selected Node or Link) are now drawn in a different way to make them easier to spot, with a thick blue border rather than a light red background color.
Many other improvements and fixes have been included in this major new release. For additional information, see the release noteshere.

Recorded Webcast: Graph Search Using Ontologies and Content Intelligence - from March 6th
Smartlogic Franz Logo
Speakers: Jan Aasman, Franz & Matthieu Jonglez, Smartlogic
Graph Search, as recently popularized by Facebook, is also relevant to enterprise information management. Companies are looking to Graph solutions that facilitate understanding of the "connectedness" of their data and as a means to manage the complexity of relationships between elements of information. The Semantic Web has long promised the value of "The Graph" and offers a world of shared information usable beyond the boundaries of legacy applications, inflexible content silos and rigid organizational boundaries. Add in the volume, velocity and variety that is Big Data and we are now hitting stride for semantic technologies to deliver on the promise.
Using real client examples, this webinar demonstrates how organizations use two types of semantic application, namely Content Intelligence and Graph Databases to organize enterprise knowledge. There are many ways to use these technologies but one that is gaining momentum is to semantically classify unstructured documents using ontologies in order to draw new data connections and meaning from very large information sets.
In this talk we will demonstrate two projects where a combination of SKOS/OWL based models, entity extraction, rule based classification, search engines and an RDF Graph Database are used to create a semantic retrieval engine for unstructured documents that delivers new insights to the user.
The business benefits of these projects have included faster development of products; more rapid time to market; improved and more efficient maintenance procedures; new ways of working with information to service customers; enhanced data security and protection; lower cost adherence to compliance tasks.
View the recording of this webinar heretarget blank image..

Practical Semantic Web - Applications, Common Lisp Edition
Mark.Watson

This new book is intended to be a practical guide for using RDF data in information processing, linked data, and semantic web applications using both the AllegroGraph commercial product and the Sesame open source project.




For additional information and to purchase, see here.

Training Schedule
Gruff

LabBECOME ALLEGRO CERTIFIED - To obtain your Allegro CL Certification enroll in our LIVE Program which offers developers an opportunity to learn and improve their Lisp programming skills from the comfort of their home or office while interacting with the Franz instructor.
Lisp Programming Series Level I: Basic Lisp Essentials - June 5, 12, and 19
Lisp Programming Series Level II: Specialized Components of Lisp - May 8, 15, and 22
For additional information and to register, see here.

Subscribe to Franz RSS feeds: RSS Feeds

Tuesday, February 12, 2013

Franz Tech Corner - February 2013



Franz Tech Corner News
February, 2013

In this issue
Free Webcast: Graph Search Using Ontologies and Content Intelligence - 10:00 AM Pacific, Wednesday, March 6th
Smartlogic Franz Logo
Speakers: Jan Aasman, Franz & Matthieu Jonglez, Smartlogic
Graph Search, as recently popularized by Facebook, is also relevant to enterprise information management. Companies are looking to Graph solutions that facilitate understanding of the "connectedness" of their data and as a means to manage the complexity of relationships between elements of information. The Semantic Web has long promised the value of "The Graph" and offers a world of shared information usable beyond the boundaries of legacy applications, inflexible content silos and rigid organizational boundaries. Add in the volume, velocity and variety that is Big Data and we are now hitting stride for semantic technologies to deliver on the promise.
Using real client examples, this webinar demonstrates how organizations use two types of semantic application, namely Content Intelligence and Graph Databases to organize enterprise knowledge. There are many ways to use these technologies but one that is gaining momentum is to semantically classify unstructured documents using ontologies in order to draw new data connections and meaning from very large information sets.
In this talk we will demonstrate two projects where a combination of SKOS/OWL based models, entity extraction, rule based classification, search engines and an RDF Graph Database are used to create a semantic retrieval engine for unstructured documents that delivers new insights to the user.
The business benefits of these projects have included faster development of products; more rapid time to market; improved and more efficient maintenance procedures; new ways of working with information to service customers; enhanced data security and protection; lower cost adherence to compliance tasks.
Register to attend this webinar heretarget blank image..

Tech Corner: Windows version now uses Unicode (and all IDE users should update!)
smp
The Windows version of Allegro CL now uses Unicode (two bytes per character) rather than ANSI (one byte per character). This provided much more flexibility in language use and locales in Common Graphics applications. However, a coding bug uncovered after the release necessitates that all users of the IDE on Windows update with new patches using sys:update-allegro or the Download Patches dialog in the IDE.

For the full article, see here

Tech Corner: Support Questions of General Interest from 2012
smp
From time to time, we report on customer questions and problem reports which might be of interest to users in general. Here are some things that came up during 2012:
  • How do I get rid of #'s in trace or debug output?
  • How can RETURN be a special operator? It is not in the list of special operators in the ANSI standard.
  • I want my own version of OPEN to be used by WITH-OPEN-FILE. Can I do that?
  • I accidentally defined a function with a keyword argument repeated, but got no warning or error, and strange behavior.
For the full article, see here.

European Lisp Symposium (ELS'13) - Madrid - June 1-4
ELS 2013
The main theme of the 2013 European Lisp Symposium is on the use of these languages with respect to the current grand challenges: big tables, open data, semantic web, network programming, discovery, robustness, runtime failures, etc. The European Lisp Symposium 2013 solicits the submission of papers with these specific themes in mind, alongside the more traditional tracks which have appeared in the past editions.
For full conference information and to register, see heretarget blank image..

AllegroGraph 4.10 - Now Available
ag-4.10



New features include: 
  • UPDATED - The Top Braid Composer Plugin, TBC version 4
  • OWL 2 RL Materializer - Generates triples by applying a set of rules to the current triples in the triple store and then places the resulting triples back in the triple store. For example, RDF-inferred triples can be generated before runtime rather than at runtime.
  • New Webview Query Screen and Graph View (Beta) - In WebView next to the Documentation menu is a link to "WebView Beta" a new UI for Query and Graph. All existing features of WebView Query are implemented.
  • The Java client can now be configured to have sessions use the main server port rather than a dedicated port
  • Improved Memory Management Functionality
  • SPARQL 1.1 Query Improvements
  • Support for Sesame 2.6.8 for the Java client.
  • MongoDB Integration - Presentation: MongoDB meets the Semantic Webtarget blank image., and a recent Webcast on MongoGraph
  • SOLR Interface for free text indexes, integrated with the SPARQL 1.1 query engine. View the webcast: Making Solr Search Smarter using RDF
  • SPIN support (SPARQL Inferencing Notation). The SPIN API allows you to define a function in terms of a SPARQL query and then call that function in other SPARQL queries. These SPIN functions can appear in FILTERs and can also be used to compute values in assignment and select expressions.
See the full list of new features and improvements here.

New Gruff release, version 4.1.5 - Now Available
gruff lab guy





New Features include:
  • There is a new outline view for browsing and editing linked nodes as an indented outline. It is especially useful for viewing hierarchies of nodes such as those using rdfs:subClassOf or skos:narrower predicates, and editing them by shifting nodes around (perhaps while adding new nodes as well).
  • Chinese Language Enhancements and numerous optimizations.
  • Many other improvements and fixes have been included in this new release. For additional information, see the release notes here.

    Recorded Webcast: A Semantic Platform for Tracking Entities in Real Time
    Solr Logo
    As presented at Semtech SF, NY, and London
    Having engaged several Fortune 500 companies with projects to develop Semantic Technology solutions we have identified several consistent requirements that have become the foundation for successful deployments of Semantic Technologies.
    The overarching pattern that we see in these companies can best be described as real time entity tracking in order to perform real time business analytics. Typical entities are students, telephone customers, credit cards or insurance policies.
    We identified and built out four components as the basis of our Semantic Technology Projects. Component one is an ETL system that takes data from various input streams and transforms the data into events, encoded as RDF triples, that go into a publish subscribe queue. To facilitate this we created a number of plugins for the open source ETL tool Talend to provide an R2RML mapping from data into triples. The second component is a forward chaining/backward chaining rule system that takes events out of the queue and combines it with the already existing knowledge about a particular entity and generates new knowledge. For some applications we see more than 10,000 triples per entity. Rules need to be able to deal with a new event in a fraction of a second. The third component is a machine learning component that is trained to generate predictions based on the features of a particular entity (for example: what is the customer going to call about when calling the call center). These predictions are again coded as individual triples. Finally, the fourth component is a reporting system that allows us to do real time analysis over all existing entities.
    Watch this recorded webcast heretarget blank image..

    Practical Semantic Web - Applications, Common Lisp Edition
    Mark.Watson

    This new book is intended to be a practical guide for using RDF data in information processing, linked data, and semantic web applications using both the AllegroGraph commercial product and the Sesame open source project.




    For additional information and to purchase, see here.

    Training Schedule
    Gruff

LabBECOME ALLEGRO CERTIFIED - To obtain your Allegro CL Certification enroll in our LIVE Program which offers developers an opportunity to learn and improve their Lisp programming skills from the comfort of their home or office while interacting with the Franz instructor.
    Lisp Programming Series Level I: Basic Lisp Essentials - April 10, 17, and 24
    Lisp Programming Series Level II: Specialized Components of Lisp - March 6, 13, and 20
    For additional information and to register, see here.

    Subscribe to Franz RSS feeds: RSS Feeds
    For more information about other Franz products and services, follow us on Twitter - @Franzinc or email - info@franz.com.

Monday, November 5, 2012

Franz Tech Corner - November 2012

In this issue