Statistical Relational Learning With Unconventional String Models

This paper shows how methods from statistical relational learning can be used to address problems in grammatical inference using model-theoretic representations of strings. These model-theoretic representations are the basis of representing formal languages logically. Conventional representations include a binary relation for order and unary relations describing mutually exclusive properties of each position in the string. This paper presents experiments on the learning of formal languages, and their stochastic counterparts, with unconventional models, which relax the mutual exclusivity condition. Unconventional models are motivated by domain-specific knowledge. Comparison of conventional and unconventional word models shows that in the domains of phonology and robotic planning and control, Markov Logic Networks With unconventional models achieve better performance and less runtime with smaller networks than Markov Logic Networks With conventional models.

1. Introduction

This article shows that statistical relational learning (Getoor and Taskar, 2007; Domingos and Lowd, 2009; Natarajan et al., 2015) provides a natural solution to the problem of inferring formal languages when the alphabetic symbols underlying the formal languages share properties.

Formal languages are sets of strings or probability distributions over strings (Hopcroft and Ullman, 1979; Kracht, 2003; Kornai, 2007). We use the word word synonymously with string. They have found application in many domains, including natural language processing, robotic planning and control (Fu et al., 2015), and human-robot interaction (Zehfroosh et al., 2017). In each of these domains there are instances where formal languages have to be inferred from observations. Grammatical inference algorithms (de la Higuera, 2010; Heinz and Sempere, 2016) address the problem of learning formal languages in theory and practice and have found success in the aforementioned domains (Fu et al., 2015; Heinz et al., 2015).

However, there is an important, unexamined assumption in much of the grammatical inference literature. Formal languages depend on an alphabet of symbols, from which the strings are built. Broadly speaking, these alphabetic symbols are treated as uniformly independent. But in many domains these symbols represent entities which may share properties, and these shared properties may ease the inference problem. In other words, it may not always be appropriate to represent strings as a sequence of independent symbols. The appropriate representation of strings in a given domain may carry richer information that is kept out of view with conventional representations of strings.

In this article, we apply finite model theory (Hodges, 1993; Libkin, 2004) to study different representations of strings and show how statistical relational learning can be used to infer formal languages using these representations. Since formal languages can be expressed with logical expressions (Büchi, 1960; Thomas, 1997), it makes sense to make the logical expressions the targets of learning. This avenue has not been extensively pursued within the grammatical inference tradition, which tends to focus on representing formal languages with automata and formal grammars (de la Higuera, 2010; Heinz and Sempere, 2016). With few exceptions, both automata and formal grammars treat symbols autonomously. However, if one were to develop learning algorithms for logical expressions within the grammatical inference tradition, we expect the result would be precisely the kind of work present in the tradition of statistical relational learning! It is in this way that this work reveals connections between statistical relational learning, model theory, and grammatical inference.

Specifically, this article re-examines the unary relations that make up word models. These are typically assumed to be disjoint: in a string with three positions like abc, a position x cannot satisfy both a(x) and b(x). In other words, x cannot simultaneously be labeled both a and b.

However, in natural languages (and often in robot planning), events in a sequence can share certain properties. For instance, in the word impossible, it is significant that the m and the p both involve lip movement in addition to a full stoppage of the airflow in the oral cavity (Odden, 2014). Hence position x corresponding to either m or p could be said to satisfy the predicates labial(x) and stop(x). However, production of m makes air flow through the nasal cavity, unlike with p. So positions x corresponding to m would satisfy nasal(x) but positions x corresponding to p would not. In this scenario, a position x which simultaneously satisfies predicates labial, nasal, and stop would be interpreted as the speech sound which we express with the single symbol m. Similarly, an aerial robot can execute the same controlled action under different conditions, e.g., it can fly in free space, as well as in proximity to ceiling, ground, or wall; yet the aerodynamics in each case can be significantly different (Karydis et al., 2015). A ground robot that can autonomously navigate can still do so while pushing an object (Parker, 1994) or carrying a load (Kiener and von Stryk, 2007)—cf. (Mellinger et al., 2013); in each case, the dynamics of the vehicle and the effect of its action on the environment are different. Thus a robot's mode of operation is similarly characterized by a particular combination of attributes and features.

There is already precedent for the importance of the representations of words for understanding the complexity of subregular formal languages (Thomas, 1997; Rogers and Pullum, 2011; Rogers et al., 2013). For example, if the relational structures underlying word models use the successor relation (+1) to represent sequential order, then long-distance dependencies require Monadic Second Order (MSO) logic to be expressed, unlike local dependencies which only require First-Order (FO) logic. Consequently, formal languages expressing local dependencies are more efficiently expressed and learned compared to those expressing long-distance dependencies with the successor representation. Conversely, if relational models underlying strings use the precedence relation (<) to represent sequential order, then certain kinds of long-distance dependencies can be expressed with Propositional (PR) logic, while those involving local dependencies require FO logic. Again it follows that formal languages expressing long-distance dependencies are more efficiently expressed and learned compared to those expressing local ones with the precedence representation. These facts are reviewed in more detail in section 4, and lends support for the idea familiar to modern artificial intelligence (AI) research, that in learning, representations matter.

We thus take advantage of domain-specific knowledge to model strings with carefully chosen sets of unary relations that capture salient properties. We show that doing so concretely simplifies the formal languages that are often learning targets, and makes it possible to reliably infer them with less data. We demonstrate this approach by applying Markov Logic Networks (Richardson and Domingues, 2006; Domingos and Lowd, 2009) to case studies drawn from the phonology of natural languages and robotic planning.

This article is organized as follows. Section 2 reviews model theory and FO logic and section 3 (MLNs). Section 4 reviews foundational aspects of formal language learning from both a categorical and probabilistic perspective. This section also introduces conventional word models and presents examples which illustrate how the character of the logical expression for a given formal language changes as a result of the model by reviewing well-studied subregular classes. Section 5 explains how well-motivated unconventional word models fit into the picture developed so far.

The remainder of the article details our experiments and contributions with Markov logic network (MLN)s. Section 6 explains general features of how we employed the software package Alchemy to learn stochastic formal languages.

Section 7 presents the first experimental contribution of this paper: an empirical demonstration on a toy problem that a MLN can emulate a smoothed n-gram model (Jurafsky and Martin, 2008) using a conventional string representation. A theoretical result in the form of a mathematical proof establishing the equivalence of n-gram models with these MLNs is left for future research. We then postulate that if statistical relational learning modules can effectively learn formal languages expressed with conventional word models as was the case with the toy problem here, then they should also succeed for unconventional word models because the conventional word model is just one of many possible representations of strings. Thus, the results in this section give us confidence that applying MLNs with unconventional word models to the problem of learning formal languages would also be meaningful and successful.

Our second contribution comes from the domain of phonology. We examine unbounded stress assignment, which is a long-distance dependency in well-formed words in some languages (Hayes, 1995; van der Hulst et al., 2010). As explained in Section 8, stress in phonology refers to the syllables which are pronounced prominently. We train MLNs based on both conventional and unconventional word models. The unconventional word model takes into account phonological representations of stress, unlike the conventional model. Our analysis shows that the MLNs with the unconventional word model generalizes more successfully on small datasets than MLNs with the conventional word model.

The third contribution is found in Section 9, where statistical relational learning is applied for the first time on a problem of (deliberate) cooperative interaction between heterogeneous robots. The first objective here is first to demonstrate how the same theory that helps us reason about words and stress, can also apply to engineering problems of planning and decision making in robotics; the second objective is to show how the use of unconventional models can both analytically and computationally facilitate the analysis of cooperative interaction between autonomous agents. The case study featured in Section 9 involves an aerial vehicle, working together and physically interacting with a ground wheeled robot, for the purpose of allowing the latter to overcome obstacles that it cannot by itself. The focus in this case study is not on learning different ways in which the vehicles can interact with each other — not on the planning of the interaction per se; this can be a subject of a follow-up study.

Instances of problems where physical interaction between autonomous agents has to be coordinated and planned to serve certain overarching goals, are also found in the context of (adaptive) robotic-assisted motor rehabilitation, which to a great extent motivates the present study. In this context, humans and robotic devices may interact both physically and socially, in ways that present significant challenges for machine learning when the latter is employed to make the robots customize their behavior to different human subjects and different, or evolving, capability levels for the same subject. One of the most important challenges faced there is that one does not have the luxury of vast amounts of training data. The algorithms need to learn reliably and fast from small data, and the overall goal of this paper is to highlight that the type of formal representation that is used for the world and available knowledge, does matter.

The last section 10 concludes.

2. Model Theory and First-Order Logic

Model theory studies objects in terms of mathematical logic (Enderton, 2001). A model of an object is a structure containing information about the object. The type of information present in a model theory of a set of objects is given by the model signature, and a set of mathematical statements about how structures are interpreted. Specifically, a model signature contains a domain (a set of elements), a set of relations, and a set of functions.¹ Here, we only consider model signatures with finite domains and whose signatures contain only relations and no functions. In other words, we apply finite model theory to relational structures (Libkin, 2004).

Model signatures define a collection of structures ${S}$ (or models, or representations), which are tuples consisting of a finite domain D, and a finite number m ∈ ℕ of n_i-ary relations R_i, for 1 ≤ i ≤ m and n_i ∈ ℕ. A structure is therefore denoted ${S}=\langle D;R_1,R_2,\dots ,R_m\rangle$. For a finite domain D, its elements are standardly given as elements of ℕ: D = {1, …k} for some k ∈ ℕ. The size of ${S}$, denoted $\left|{S}\right|$, coincides with the cardinality of its domain. In the context of this paper, the model signature, denoted 𝔐 = 〈𝔇; ℜ〉, specifies what kind of elements and relations are present in a structure. Here, 𝔇 is a set of domains, and ℜ is a set of relations in a particular structure. Thus a structure ${S}$ of signature 〈𝔇; ℜ〉 will have D ∈ 𝔇 and 〈R₁, …, R_m〉 ∈ ℜ, in other words, structures are specific instantiations of some particular signature. Such instantiations are referred to as groundings. Given a finite set C of constants (domain elements), the Herbrand base of all the possible groundings of the relations in ℜ with respect to C is H_C = {R(c₁…c_n)∣Ris an n-ary relation inℜ, c_i ∈ C}.

A signature gives rise to a FO logical language where the names of the relations in ℜ become atomic predicates in the logic. In FO logic, there are variables x, y, z… which range over the elements in the domain of the structure. The logical language has a syntax to define sentences. These are usually defined inductively with the predicates and variable equality (=) serving as base cases, and with the inductive cases provided by Boolean connectives (∧, ∨, →, ↔) between formulas, in addition to quantification (∃, ∀) over formulas. The logical language also has a semantics, which lets one determine whether a well-formed logical formula φ is true for some structure ${S}$. This semantics is compositional and can be computed following the syntactic structure of φ. We assume some previous familiarity with FO logic. Enderton (2001) and Libkin (2004) provide good references for formal treatments.

3. Markov Logic Networks

We adapt the presentation of De Raedt et al. (2016). A Markov Network is a representation of a Markov random field (Pearl, 1988). It expresses graphically the joint distribution of a collection of random variables X = {X₁, X₂, …X_n} taking values in some space ${X}$. Here, these random variables are assumed discrete and finite. A Markov Network representation consists of an undirected graph and a set of potential functions ϕ_k. There is one such potential function ϕ_k for every clique in the graph, and the clique associated with potential function ϕ_k is denoted {k}. The subset of random variables associated with that clique is denoted X_{k}.

If a particular valuation of X is denoted x, and given that ${X}$ is finite, one can define the partition function

$\begin{array}{ll}Z={\displaystyle \sum _{x\in {X}}}{\displaystyle \prod _k}{\varphi }_k(x_{\left\{k\right\}})& (1)\end{array}$

Then the joint probability distribution of the network can be factored over the network's cliques in the form

$\begin{array}{l}\text{P}(X=x)=\frac{1}{Z}{\displaystyle \prod _k}{\varphi }_k(x_{\left\{k\right\}})\end{array}$

Usually, a log-normal representation for this joint probability distribution is utilized, in the form of an exponential of a weighted sum of real-valued feature functions f_j(x). There is one such feature f_j for each possible valuation of the state x in clique k, and this feature is weighted with w_j = logϕ_k(x_{k}). In this form, the joint probability distribution is

$\begin{array}{l}\text{P}(X=x)=\frac{1}{Z}\text{exp}\left({\displaystyle \sum _j}{w}_j{f}_j(x)\right)\end{array}$

A MLN is a set of pairs (F_i, w_i), where F_i is a first order formula and w_i is a real number. Note that an FO logic associated to some signature 〈𝔇; ℜ〉, naturally provides such formulas. The MLN now becomes a template for generating Markov networks: given a domain D ∈ 𝔇 and a collection of atomic predicates 〈R₁, …, R_m〉 ∈ ℜ with signature 〈𝔇; ℜ〉, there is a node for every possible grounding of an atomic predicate R_i, and a feature f_j for each possible grounding of a formula F_i. In fact, despite being different depending on the choice of D and R_i, all of these ground Markov networks have the same potential for a given formula F_i, namely ${\varphi }_i(x_{\left\{i\right\}})={\mathrm{\text{e}}}^{w_i}$. The feature f_j(x) is equal to the number of all true groundings of formula F_j in x. It is denoted n_Fj. Thus, the joint distribution of the ground Markov network generated by the MLN is expressed by

$\begin{array}{l}\text{P}(X=x)=\frac{1}{Z}{\displaystyle \prod _i}{\varphi }_i(x_{\left\{i\right\}}{)}^{n_{F_i}(x)}\\ =\frac{1}{Z}{\displaystyle \prod _i}\text{exp}(w_i{n}_{F_i}(x))\\ =\frac{1}{Z}\text{exp}{\displaystyle \sum _i}{w}_i{n}_{F_i}(x)& (2)\end{array}$

Since each structure ${S}$ corresponds to a particular instantiation of the random vector X = x given the set of formulas and weights (F_i, w_i), (2) essentially expresses the probability that the MLN assigns to a particular structure:

$\begin{array}{ll}P({S})=\frac{1}{Z}\text{exp}{\displaystyle \sum _i}{w}_i{n}_{F_i}({S})& (3)\end{array}$

From a learning perspective, natural problems include finding either the weights of given formulas or both the weights and the formulas themselves (Domingos and Lowd, 2009, Chapter 4). In this paper we only concern ourselves with the former problem and assume the specific domains provide the formulas a priori.

For any parametric model M with a set of parameters P and set of data D, the maximum likelihood estimate (MLE) refers to the parameter values $\widehat{P}$ that maximize the likelihood of the D according to M. In other words any parameter values which deviate from $\widehat{P}$ will result in M assigning a smaller probability to D. MLNs are parametric models where the weights are the parameters. Finding the MLE is thus a natural learning problem for MLNs.

In principle, the weights of the formulas of a MLN that yield the MLE of the data can be found by adjusting their values so as to reduce the difference between the actual counts of the groundings of the formulas in the data and the expected counts given the current weights on the formulas. This is expressed with partial derivative of the log-likelihood of the data D below for a given set 〈F, w〉 of pairs of formulas and weights (F_i, w_i) in the MLN.

$\begin{array}{l}\frac{\partial }{\partial w_i}\text{log }{\text{P}}_{\langle F,w\rangle }(D)=n_{F_i}(D)-{\text{E}}_{\langle F,w\rangle }[n_{F_i}(D)]\end{array}$

Then standard optimization techniques, such as gradient descent, the conjugate gradient, and Newton's method, or variants thereof, can be used to find weights corresponding to the MLE of the data given the MLN. In practice, computing $n_{F_i}({S})$ is challenging. The gradient of the pseudo-log-likelihood is often calculated instead as this is much more efficient. The price paid is that any guarantees of convergence to maximum likelihood are lost. Gaussian priors to prevent overfitting are also used.

4. Strings and Stringsets

Strings (words) are familiar: they are sequences of symbols and formal languages are sets of strings. Formal language theory studies the computational nature of stringsets (Hopcroft and Ullman, 1979). Since patterns in strings can be represented with formal grammars, the question addressed by the field of grammatical inference is how grammars, such as automata, can be learned under various learning paradigms (de la Higuera, 2010; Heinz and Sempere, 2016). However, stringsets can also be expressed with logic. Learning these logical expressions is therefore another strategy for inference. This is where relational learning, statistical relational learning, and related fields like Inductive Logic Programming become relevant.

In this section, we provide formal background and notation on strings, formal languages, finite-state automata, logic, and model theory. Connections among them are made along the way.

4.1. Strings

In formal language theory, the set of symbols is fixed, finite and typically denoted with Σ. The free monoid Σ* is the smallest set of strings which contains the unique string of length zero λ (the identity element in the monoid) and which is closed under concatenation with the symbols from Σ. Thus, if w ∈ Σ* and σ ∈ Σ then wσ ∈ Σ* where wσ represents the string obained by concatenating σ to the end of w. Concatenation applies between strings as well. If u and v are strings, then uv represents their concatenation.

For all u, v, w, x ∈ Σ*, if x = uwv then w is a substring of x. If $x\in {\Sigma }^{*}{\sigma }_1{\Sigma }^{*}{\sigma }_2{\Sigma }^{*}\dots {\sigma }_n{\Sigma }^{*}$ then w = σ₁σ₂…σ_n is a subsequence of x. A substring (subsequence) of length k is called a k-factor (k-subsequence). Let factor_k(w) denote the set of substrings of w of length k. Let subseq_k(w) denote the set of subsequences of w up to length k. The domains of these functions are extended to languages in the normal way.

We sometimes make use of left and right word boundary markers (⋊ and ⋉, respectively), but do not include those in Σ.

4.2. Stringsets

Formal languages are subsets of Σ*. For example suppose Σ = {a, b} and consider the set of strings which contains an even number of as, which we denote E_a. E_a is a subset of Σ*. It is useful to identify every formal language S ⊆ Σ* with its characteristic function $f_S:{\Sigma }^{*}\to \left\{0,1\right\}$. Continuing the example, if w = abaaa, then f(w) = 1 since the string w has an even number of as and so belongs to E_a, but if w = abbaa, then f(w) = 0 since it has an odd number of as and does not belong to E_a. This shift in perspective provides a direct parallel to the study of probability distributions over Σ*. These are expressed as functions whose co-domains are the real-interval [0, 1]. Formally they are f:Σ* → [0, 1] such that $\sum _{w\in {\Sigma }^{*}}f(w)=1$. In other words, sets of strings and probability distributions over strings are identified as functions with domain Σ*. We use the term categorical stringsets to refer to subsets of Σ* identified with f:Σ* → {0, 1} and the term stochastic stringsets to refer to subsets of Σ* identified with f:Σ* → [0, 1]. We use the stringset to refer to both categorical and stochastic ones.

One important problem studied addressed in formal language theory is the membership problem, which is the problem of deciding whether an arbitrary string in Σ* belongs to a categorical stringset. A closely related problem is determining the probability of an arbitrary string in a stochastic stringset. In each case, the problem is, for all w ∈ Σ*, to compute the output of f(w).

These functions f may be learned from examples. There are different ways the learning problem can be formulated (Jain et al., 1999; De Raedt, 2008; de la Higuera, 2010; Clark and Lappin, 2011; Heinz, 2016). One way is to require that the data sample input to the learning algorithms only contains positive evidence. For functions f:Σ* → {0, 1} this means the evidence only contains words w such that f(w) = 1. For functions f:Σ* → [0, 1] which are probability distributions this usually means the evidence is obtained according to independent and identically distributed (i.i.d.) draws from f.

Both the membership and learning problems are closely related to the study of formal grammars. It is well-known, for instance, that if the functions f are regular functions then computing f(w) is straightforward.

4.3. Regular Stringsets and Automata

Informally, regular stringsets are those whose membership problem can be decided by a computation model whose memory is independent of the length of the input w. Such stringsets underlie many applications in natural language processing (Mohri, 2005) and planning and control (Kress-Gazit et al., 2009). Formally, regular stringsets can be characterized in multiple, independently motivated ways from automata theory, logic, and algebra (Thomas, 1997; Droste and Gastin, 2009).

DEFINITION 1. A real-weighted deterministic finite-state acceptor (RDFA) is a tuple (Σ, Q, q₀, δ, ρ, α):

A (RDFA) processes strings (words) in Σ* reading them from left to right, and transitioning from one state to another upon reading each of the symbols in the input string.

Each RDFA gives rise to a function f:Σ* → [0, 1]. The function f associated with an RDFA A = (Σ, Q, q₀, δ, ρ, α), and henceforth denoted f_A, can be derived as follows. Let a dot (·) denote real number multiplication, a backslash (\) set difference. Define the function “process”

$\begin{array}{l}\pi :Q\times {\Sigma }^{*}\times \left[0,1\right]\to \left[0,1\right]\end{array}$

recursively as follows:

$\begin{array}{l}\pi (q,\lambda ,r)=r·\alpha (q)\\ \pi (q,wa,r)=\pi (\delta (q,a),w,r·\rho (q,a))\end{array}$

In other words, π(q, wa, r) processes wa from state q with current value r by successively transitioning the RDFA A to the next state as given by the letter a and transition function δ. The value r is updated at each step by multiplying the real-valued weight associated with that transition ρ(q, a). When the process concludes at state q, the value r is multipled by α(q). Then f_A can be defined as

$\begin{array}{l}{f}_A(w)\underset{\_}{\underset{\_}{\text{def}}}\pi (q_0,w,1) .\end{array}$

Note that f_A(w) may be undefined for some w if δ, ρ, and α are undefined for some (q, σ).

The recursive path of computation given by π indicates how the membership problem for any stringset definable with a RDFA is decided. Examples are given below.

If for each state q ∈ Q it holds that

$\begin{array}{l}{\displaystyle \sum _{\sigma \in \Sigma }}\rho (q,\sigma )+\alpha (q)=1\end{array}$

then f_A computes a probability distribution over Σ* (de la Higuera, 2010). We call such an RDFA a probabilistic deterministic finite-state acceptor (PDFA) because the real-valued weights can be interpreted as probabilities. Strings w for which f_A(w) are undefined are said to have probability 0.

As an example, let Σ = {a, b, c} and consider the graphical representation of the PDFA A shown in Figure 1. This PDFA is used in the case study in Section 7. This PDFA has four states: Q = {a,b,c,start} indicated by the circles and diamond bearing those labels. The δ, ρ, and α functions are indicated by the arrows (which we also call transitions) as follows. For all q, r ∈ Q, if there is an arrow from state q to r then δ(q, r) = r. Thus from the start state, upon processing the symbol a, the PDFA transitions to state a. The numbers on the transitions between states shows the ρ function. For example, ρ(start, a) = 0.33 and ρ(b, a) = 0.2. The α function is shown with the arrows from the states to the circle labeled “end.” For example α(a) = 0.3. The probability A assigns to the string ab is calculated as follows.

$\begin{array}{l}{f}_a(ab)=\pi (\text{start},ab,1)=\pi (a,b,1·0.33)=\pi (b,\lambda ,1·0.33·0.2)\\ =1·0.33·0.2·0.3=0.01980\end{array}$

Note the final product above correlates with the probabilities along the “path” taken by A when processing ab: 1·ρ(start, a)·ρ(a, b)·α(b).

FIGURE 1

Figure 1. The PDFA A is the basis for the case study in section 7.

Next we turn to RDFAs for defining categorical stringsets. If for each state q ∈ Q and σ ∈ Σ it holds that ρ(q, σ) equals 1, 0, or is undefined and α(q) equals 1, 0, or is undefined, then f_A identifies a characteristic function of a regular categorical stringset S ⊆ Σ*. Strings w for which f_A(w) = 1 are said to be accepted. Strings for which f_A(w) = 0 or are undefined are said to be rejected; in the latter case, we let f_A(w) = 0. We call such an RDFA a deterministic finite-state acceptor (DFA).

As an example, let Σ={H, $\stackrel{\prime }{\text{H}}$, L, Ĺ} and consider the DFA A_LHOR shown in Figure 2. The categorical stringset represented by this DFA is the basis for the case study in Section 8. In Figure 2, Q={start,1,2}, and the δ and ρ functions are as follows. For all q, r ∈ Q, if there is an arrow from state q to r labeled σ then δ(q, σ) = r. If no such arrow is present for q, σ then δ(q, σ) is undefined. Thus from the start state, upon processing the symbol $\stackrel{\prime }{\text{H}}$, the DFA transitions to state 2. Similarly, for all q, r ∈ Q, ρ(q, σ) = 1 iff there is an arrow from state q to r labeled σ; otherwise ρ(q, σ) = 0. The α function is defined as follows: α(1) = α(2) = 1 and α(start) = 0.

FIGURE 2

Figure 2. The DFA A_LHOR is the basis for the case study in section 8.

Witness the following computation of A_LHOR on input LL.

$\begin{array}{l}{f}_{A_{\text{LHOR}}}(\text{LL})=\pi (\text{start, LL, 1})=\pi (\text{start, L},1·1)\\ =\pi (\text{start},\lambda ,1·1·1)=1·1·1·0=0\end{array}$

Thus A_LHOR rejects this string. On the other hand, A_LHOR accepts LĹ.

$\begin{array}{l}{f}_{A_{\text{LHOR}}}(\text{LĹ})=\pi (\text{start, LĹ, 1})=\pi (\text{start, Ĺ},1·1)\\ =\pi (1,\lambda ,1·1·1)=1·1·1·1=1\end{array}$

The reader may verify that A_LHOR also rejects ĹH and accepts L$\stackrel{\prime }{\text{H}}$. The significance of what this categorical stringset represents is discussed in Section 8.

4.4. Learning Regular Stringsets

There are learning results for the general case of learning any regular stringset and results for learning subclasses of regular stringsets. An early result was that regular categorical stringsets cannot be learned exactly from positive evidence only (Gold, 1967), though they can be learned exactly from positive and negative evidence (Oncina and Garcia, 1992). There are also theoretical guarantees for learning regular, stochastic stringsets to any arbitrary degree of precision (Carrasco and Oncina, 1994, 1999). De la Higuera (2010) gives a comprehensive uniform presentation of such results.

Each DFA describes a class of categorical stringsets, and each stringset in this class can be learned exactly from positive evidence only (Heinz and Rogers, 2013). Similarly, each PDFA describes a class of stochastic stringsets by varying ρ and α and keeping the other aspects of the PDFA constant. One way then to express the problem of learning a stochastic stringset associated to a PDFA is to set ρ and α so that they maximize the likelihood of the data (MLE). There is a simple solution to this problem which amounts to normalizing the counts of the PDFA's parsing of this data (de la Higuera, 2010).

4.5. Logical Descriptions of Stringsets

Regular stringsets can also be defined logically. Traditional logic is used for categorical stringsets and weighted logic for stochastic stringsets (Droste and Gastin, 2009). Informally, an unweighted logical expression φ picks out the strings which satisfy the condition expressed by φ. Similarly, a weighted logical expression will assign weights (for example real numbers) to strings.

In order to define a stringset with a logical expression, the logical expressions need to be able to refer to aspects and properties of the string. This is where model theory becomes relevant. Model theory makes explicit the representation of objects. Combined with a logic, such as FO or MSO, a logical language is produced. The expressions of these logical languages define stringsets.

For example, consider the unweighted logical expression shown below, which is read as “for all x, it is not the case that x is labeled with a.”

$\begin{array}{l}\phi \underset{\_}{\underset{\_}{\text{def}}}(\forall x)\left[\neg \text{a}(x)\right]\end{array}$

In plain English, this means “Well-formed words do not contain the letter a.” For example, strings like bcb satisfy φ since no position x is labeled a. However, the string bab does not satisfy φ because when x is assigned to the second position in the string, it satisfies a(x) and hence makes φ false.

In general, the interpretation of φ depends on what the atomic predicates are in the models of words. Conventional models of strings are relational structures, whose signature contains |Σ| unary relations and a single binary relation which represents the order between the elements of the string. For concreteness, let us examine two distinct conventional model-theoretic representations of words.

For the sake of this analysis let Σ = {a, b, c} and let the set of objects of interest be Σ*. Then following Rogers and Pullum (2011) and Rogers et al. (2013), one conventional model for words can be the Successor Word Model (𝔐^⊲), which is given by the signature 〈𝔇; ⊲, R_a, R_b, R_c〉 where ⊲ is the binary ordering relation successor and for each σ ∈ Σ, R_σ is a unary relation denoting which elements are labeled σ.

Contrast this with another conventional model for words: the Precedence Word Model (𝔐^<). This model (structure) has signature 〈D; <, R_a, R_b, R_c〉 where < is the binary ordering relation precedence, and the unary relations R_σ are the same as in 𝔐^⊲.

Under both model signatures, each string w ∈ Σ* of length k has a unique interpretable structure. The model of string w = σ₁σ₂…σ_k has domain D = {1, 2…k}, and for each σ ∈ Σ, R_σ = {i ∈ D∣w_i = σ}. The difference between 𝔐^⊲ and 𝔐^< is the ordering relation. Under the successor model 𝔐^⊲, the ordering relation is ⊲ $\underset{\_}{\underset{\_}{\text{def}}}$ {(i, i + 1) ∈ D×D}, while for the precedence model 𝔐^<, the ordering relation is < $\underset{\_}{\underset{\_}{\text{def}}}$ {(i, j) ∈ D×D∣i < j}.

Figure 3 illustrates these different word models with the word cabb, along with graphical representations of the models. In these graphs, nodes represent domain elements; binary relations are shown with directed labeled edges; and unary relations are shown as labels above the nodes. Note that in both models R_a = {2}, R_b = {3, 4}, and R_c = {1}. While the unary relations in these models illustrated in Figure 3 are the same because the same positions have the same labels, information about the order of the elements is represented differently.

FIGURE 3

Figure 3. Successor and precedence models for word cabb with graphical representations.

It follows that certain conditions must be met for structures to be interpretable as strings. In both theories, for a structure ${S}$ with domain D to be interpretable as a word, each element in D must have at least one label—symbolically translated as (∀i ∈ D)(∃σ ∈ Σ)[i ∈ R_σ]— and at most one label—again, mathematically expressed as $(\forall \sigma ,{\sigma }^{\prime }\in \Sigma )\left[R_{\sigma }\cap R_{{\sigma }^{\prime }}=\varnothing \right]$. Furthermore, in both theories every element must be ordered.

For example, the structure ${S}=\langle \left\{1,2\right\};\varnothing ,\left\{1\right\},\left\{2\right\},\varnothing \rangle$ is a case of a structure which is not interpretable as a string in either 𝔐^⊲ or 𝔐^<. Structure ${S}$ in this case specifies two elements, one of which is labeled a and the other is labeled b, but the order of these elements remains unspecified. Another example of a structure which does not correspond to a string is ${S}=\langle \left\{1\right\};\varnothing ,\left\{1\right\},\left\{1\right\},\varnothing \rangle$; here there is one element which is labeled both a and b.

4.6. Subregular Complexity

Depending on the choice of model and logic different classes of stringsets arise (Büchi, 1960; McNaughton and Papert, 1971; Thomas, 1982, 1997; Rogers et al., 2010, 2013; Rogers and Pullum, 2011). Figure 4 shows proper inclusion relationships among many such classes. The figure and subsequent discussion provides logical characterizations for categorical stringsets, but stochastic versions for each can be given with weighted logics (Droste and Gastin, 2009). For completeness, language-theoretic definitions of each class are given below and other characterizations based on automata and algebra are omitted.

FIGURE 4

Figure 4. Subregular Hierarchies from a model-theoretic perspective.

We have already defined regular stringsets as those characterized by a DFA or PDFA. Büchi (1960) showed these are exactly the categorical stringsets definable with weak MSO logic with the order relation given as successor (or precedence, since the precedence relation is MSO-definable from successor and vice versa). We now define the other classes in Figure 4 moving left-to-right and top-to-down.

DEFINITION 2 (Locally Threshold Testable Thomas, 1982).

A stringset L is Locally Threshold Testable iff there are two numbers k and t such that for all strings u, v ∈ Σ* and k-factors $x\in {\mathtt{\text{factor}}}_k(\left\{⋊\right\}{\Sigma }^{*}\left\{⋉\right\})$, whenever x occurs either at least t times in both u and v or an equal number of times in both u and v, then either u, v ∈ L or u, v ∉ L.

In other words, membership of a string w in any LTT_{t, k} stringset is determined solely by the number of occurrences of each k-factor in w, counting them only up to some threshold t. Thomas (1982) showed that FO-definable categorical stringsets with the successor model 𝔐^⊲ are exactly the Locally Threshold-Testable stringsets.

DEFINITION 3 (Non-Counting). A stringset L is Non-Counting iff there is a k such that for all w, u, v ∈ Σ*, if wuv ∈ L then wu^{k + 1}v ∈ L.

McNaughton and Papert (1971) showed that FO-definable stringsets with the precedence model 𝔐^< are exactly the Non-Counting stringsets. They also prove languages in the Non-Counting class are exactly those definable with star-free generalized regular expressions and exactly those obtained by closing LT stringsets under concatenation. Hence this class also goes by the names “Star-Free” and “Locally Testable with Order.” The Non-Counting class properly includes the Locally Threshold Testable languages because the successor relation is FO-definable from precedence but not vice versa.

Finally, observe that stringsets that are regular but not Non-Counting typically count modulo some n. For example, the stringset which contains all and only strings with an even number of as is not Non-Counting, but regular.

DEFINITION 4 (Locally Testable Rogers and Pullum, 2011).

Language L is Locally k-Testable (LT_k) iff there is some k such that, for all strings x and y, if factor_k(⋊x⋉) = factor_k(⋊y⋉) then x ∈ L↔y ∈ L. Stringset L is Locally Testable (LT) if there is some k such that L ∈ LT_k.

From a logical perspective, Locally Testable languages are ones given by a propositional calculus whose propositions correspond to factors (Rogers and Pullum, 2011). With respect to FO logic, they may be understood as belonging to the B(Σ₁), which is the Boolean closure of FO formulas (with successor) which begin with a single block of existential quantifiers in prenex normal form (Thomas, 1997). Note that LT_k class equals LTT_1,k.

DEFINITION 5 (Piecewise Testable). A language L is Piecewise k-Testable (PT_k) iff there is some k such that, for all strings x and y, if subseq_k(x) = subseq_k(y) then x ∈ L↔y ∈ L. Stringset L is Piecewise Testable (PT) if there is some k such that L ∈ PT_k.

Piecewise Testable languages are ones given by a propositional calculus whose propositions correspond to subsequences (Rogers et al., 2013). With respect to FO logic, they may be understood as belonging to the B(Σ₁), which is the set of Boolean closure of FO formulas (with precedence) which begin with a single block of existential quantifiers in prenex normal form (Thomas, 1997).

DEFINITION 6 (Strictly Local Rogers and Pullum, 2011). A stringset L is Strictly k-Local (SL_k) iff whenever there is a string x of length k−1, and strings u₁, v₁, u₂ and v₂ such that u₁xv₁, u₂xv₂ ∈ L, then u₁xv₂ ∈ L. Stringset L is Strictly Local (SL) if L ∈ SL_k for some k. We say L is closed under suffix substitution.

From a logical perspective, Strictly k-Local languages are ones given by a conjunction of negative literals (propositions) where literals correspond to k-factors (Rogers and Pullum, 2011). This means that a Strictly k-Local stringset only includes strings which do not contain any forbidden substring of length k (of which there can only be finitely many). For example, the conjunction ¬aa ∧ ¬bb means that aa and bb are forbidden substrings. If Σ = {a, b} then the only strings satisfying this expression alternate as and bs. With respect to FO logic, Strictly Local stringsets may be understood as belonging to Π₁, which is the set of FO formulas (with successor) which begin with a single block of universal quantifiers in prenex normal form (Thomas, 1997).

From an automata perspective, the SL_k class of stringsets is represented by a RDFA as follows. The states are strings whose lengths are less than k (the start state corresponds to the empty string), and its δ function maps a state q and symbol σ ∈ Σ to the longest suffix of qσ whose length is less than k. For instance, if k = 4 then δ(a, b) = ab and δ(abc, a) = bca. With the structure of the RDFA so determined, each stringset S ∈ SL_k reduces to a particular functions ρ and α. Such DFAs define categorical SL_k stringsets and such PDFAs define stochastic ones. The experiments in Sections 7 and 9 have SL stringsets as learning targets.

DEFINITION 7 (Strictly Piecewise Rogers et al., 2010). A language L is Strictly k-Piecewise (SP_k) iff subseq_k(w) ⊆ subseq_k(L) implies w ∈ L. Stringset L is Strictly Piecewise (SP) if there is a k such that it belongs to SP_k; equivalently, L belongs to SP iff L is closed under subsequence.

From a logical perspective, Strictly Piecewise languages are ones given by a conjunction of negative propositions where propositions correspond to factors (Rogers et al., 2010). This means that a Strictly k-Piecewise stringset only includes strings which do not contain any forbidden subsequences of length k (of which there can only be finitely many). For example, the conjunction ¬aa ∧ ¬bb means that aa and bb are banned subsequences. If Σ = {a, b, c} then the only strings satisfying this expression contain at most one a and at most one b. With respect to FO logic, they may be understood as belonging to Π₁, which is the set of FO formulas (with precedence) which begin with a single block of universal quantifiers in prenex normal form (Thomas, 1997). Rogers et al. (2010) provide an automata-theoretic characterization.

While the subregular classes of stringsets in the above diagram exhibit different properties, the logical characterizations make the parallels between the two sides of the hierarchy clear. The Strictly Local and Strictly Piecewise classes are relevant to the experiments presented later.

4.7. Sub-structures

For any two relational structures ${{S}}_1$ and ${{S}}_2$ of the same theory, we say ${{S}}_1$ is a sub-structure of ${{S}}_2$ (written ${{S}}_1⊑{{S}}_2$) iff there exists an injective homomorphism h which maps every element in D₁, the domain of ${{S}}_1$, to elements in D₂, the domain of ${{S}}_2$, such that all n-tuples of elements of D₁ and for all n-ary relations R_ij with i ∈ {1, 2} and j = 1, …, m, we have (x₁, …, x_n) ∈ R_1j iff (h(x₁), …h(x_n)) ∈ R_2j.

For example under 𝔐^⊲, ${{M}}_{ab}$ is a sub-structure of ${{M}}_{cabb}$. (Let h map 1 to 2 and 2 to 3.) Under 𝔐^<, ${{M}}_{cb}$ is a sub-structure of ${{M}}_{cabb}$. (Let h map 1 to 1 and 2 to 3 (or 4).)

The lemma below is not difficult to prove.

LEMMA 1. For all u, v ∈ Σ*, word u is a substring of v iff ${{M}}_u^{⊲}⊑{{M}}_v^{⊲}$. Likewise, u is a subsequence of v iff ${{M}}_u^{<}⊑{{M}}_v^{<}$.

Not only do these facts help make clear the similarities between substrings and subsequences observed in earlier works (Lothaire, 1997, 2005; García and Ruiz, 2004), they also show that what a sub-structure is depends on the model. As we will see in sections 8 and 9, sub-structures play an important role in unconventional models and relational learning, where it provides a generality relation in the sense of De Raedt (2008).

4.8. Learnability of Subregular Classes

From a learning perspective, the characterizations place limits on what kinds of stringsets can be learned when learning systems rely on FO logic. MLNs, for example, can never exactly learn any regular stringset that is not Non-Counting because those cannot be expressed with FO formulas. On the other hand whether a MLN can learn a Non-Counting stringset may well depend in part on whether the word model employs the successor relation, the precedence relation or both.

It is known that for given k, the strictly k-local stringsets are identifiable in the limit from positive data (García et al., 1990). This result can be generalized to the SP_k, LT_k, PT_k, and LTT_t,k stringsets (García and Ruiz, 2004; Heinz, 2010; Heinz et al., 2012).

5. Unconventional Models

In many domains of interest—including natural language processing and robotic planning and control—stringsets are used to characterize aspects of the nature of system. While conventional word models may be sufficiently expressive for problems in these domains, they do not take advantage of domain-specific knowledge. Specifically, in the conventional word models discussed previously, the unary relations are such that each position in a word can only satisfy one such relation. It is not the case that a position can satisfy two unary relations simultaneously.

Here is a simple motivating example. If we restrict ourselves to the alphabet {a, …z, A, …Z}, then under a conventional model there are 52 unary relations. Upper and lowercase versions of these symbols, e.g., a and A, are in no way associated. However, an unconventional word model that takes such associations into account might posit just 27 unary relations {a, …z, capital}. For a word like Mama, both capital(1) and m(1) would be true. In this way, this unconventional model captures the similarity between corresponding lowercase and uppercase letters.

In the context of learning stringsets, these correspondences can, and should be, exploited. Current learning approaches based on automata are challenging since automata are best understood as processing individual symbols. On the other hand, relational learning methods can immediately be applied to this problem. As explained in Section 4, different logical languages from different word models yield different classes of stringsets. The subregular hierarchies in Figure 4 exemplify the nature of the classes obtained when representational primitives are changed between successor and precedence models. The goal here is to expand the horizontal axis in Figure 4 to consider word models where the assumption that the unary relations are disjoint, is relaxed.

In the remainder of this paper we apply MLNs (Section 3) to learning stringsets (Section 4) with model-theoretic treatments of words (Section 2). We present three experimental case studies. In each case study, we provide the formulas and learn the weights.

The first case study serves as a sanity check. We expect that MLNs should be able to learn stringsets from examples, regardless of whether the strings are represented with conventional or unconventional word models. Therefore, we ask whether an MLN can mimic n-gram models. These are parametric models widely used in natural language processing (NLP) which implicitly adopt the conventional successor model. From the perspective of the Subregular Hierachies (Figure 4), n-gram models are stochastic Strictly n-Local stringsets. The case study explains how to express the logic underlying SL_k stringsets, and how to express this logic with MLNs. The experimental result shows that the learning behavior of the MLN closely mimics the learning behavior of the n-gram model. We conclude that MLNs can instantiate n-gram models, but are much more general because other parametric models can be instantiated with MLNs by changing both the underlying model-theoretic representation of strings and the logical formulas.

This knowledge is put to use in the subsequent case studies. The second case study is about the problem of learning an aspect of one's phonological grammar: how to assign stress (a type of prominence) in words. The stress pattern we describe is amenable to multiple logical descriptions. We offer two: one using a conventional precedence model and one with an unconventional precedence model. We show learning the stress pattern requires less data and less computation time if the unconventional model is used.

The third case study illustrates the application of MLNs and unconventional models to an engineering problem where one (a machine) has to learn how two pieces of hardware—in this case, mobile robots—can interact with each other and work together as a team. In the particular case study, the interaction is meaningful and needed, because the task that needs to be performed cannot be accomplished by only one robot working in isolation. The idea behind this case study is that one may obtain a set of example interaction cases by having a skilled (human) operator coordinating the robots over, possibly, a variety of different tasks. Then the problem is how to construct a formal model that captures and generalize possible ways of interaction between these agents, which would be an important first step into planning the coordination in a fully autonomous way at a later stage. In addition to demonstrating that the statistical relational learning framework is general enough to be useful in different application spaces, this last case study allows one to draw similar conclusions as before regarding the efficiency of learning algorithms when applied to unconventional models.

6. Implementation in Alchemy

We used the software package Alchemy 2 (Domingos and Lowd, 2009) to implement the experiments with MLNs described in the following sections. Appendix A in Domingos and Lowd (2009) provides details of the Alchemy system. The Alchemy website http://alchemy.cs.washington.edu provides source code and additional documentation.

For each experiment, there are two input files for weight learning. One is a .mln file that lists the FO formulas in the language of the model-theoretic representation which define the MLN.

Our case studies are mostly limited to Strictly k-Local and Strictly k-Piecewise stringsets so we illustrate how they can be implemented as MLNs in the .mln files with a simple example. Let Σ = {a, b} and consider a Strictly 2-Local grammar. The input .mln file contains statements of the possible predicates in the successor model. Since there are four 2-factors, {aa, ab, ba, bb}, there would be four FO statements (where adjacent stands for the successor relation):

$\begin{array}{l}\text{adjacent}(x,y)\wedge \text{a}(x)\wedge \text{a}(y)\\ \text{adjacent}(x,y)\wedge \text{a}(x)\wedge \text{b}(y)\\ \text{adjacent}(x,y)\wedge \text{b}(x)\wedge \text{a}(y)\\ \text{adjacent}(x,y)\wedge \text{b}(x)\wedge \text{b}(y)\end{array}$

In the same .mln file, we would declare the following predicates:

$\begin{array}{c}\text{adjacent}(\text{char},\text{char})\\ \text{a}(\text{char})\\ \text{b}(\text{char})\end{array}$

If we were to consider a Strictly 2-Piecewise grammar, then the .mln file would be very similar to the one just described. The only difference would be that instead of the adjacent predicate, the four FO formulas would contain the follows predicate (which stands for the precedence relation).

The other input file to Alchemy 2 is a training database (.db file) which provides the sample data which is the input to the MLN. The training database provides a list of evidential predicates, also called ground atoms. These essentially are the model-theoretic representations of the strings in the data sample.

To represent each input string in the training database, each position in each string are indexed with a dummy denotation. We used capitalized letters of the alphabet and their combinations. These positions correspond to elements of the domain in a word model. Having that, we then list the properties of each position, and also the binary relations between positions.

For example, a string in the training dataset of the current example might be ‘cabb’. For such a string, we get the following list of atoms in the .db file (cf. Figure 3) under the successor model 𝔐^⊲.

$\begin{array}{l}\{\text{c}(A),\text{a}(B),\text{b}(C),\text{b}(D),\text{adjacent}(A,B),\\ \text{adjacent}(B,C),\text{adjacent}(C,D)\}\end{array}$

In an unconventional word model, more than one unary relation may be listed for some node. How the set of strings for each training dataset was generated for each case study is described later.

When Alchemy 2 is run with these input files, it produces an output file which provides the learned weights for each statement in the .mln file. For running the weight-learning function, we used generalized weight-learning (command-line option −g), with no listing of non-evidence predicates and default parameters.

Each of our case studies required some specific treatment beyond the overall methods described above, which we discuss as appropriate in the subsequent sections.

7. Comparison of MLNs With n-Gram Models

N-gram models are widely used in natural language processing (Jurafsky and Martin, 2008). An n-gram model can be understood as a PDFA whose underlying structure is Strictly n-Local.

This section shows that MLNs can mimic n-gram models. Specifically, our experiments demonstrate that a trained bigram model and a trained MLN behave similarly. We leave establishing the theoretical facts for future research.

7.1. Target Stochastic Stringset

The PDFA A in Figure 1 in section 4.3 exemplifies a n-gram model with n = 2 and Σ = {a, b, c}. As such, it represents a stochastic Strictly 2-Local stringset $f_A:{\Sigma }^{*}\to \left[0,1\right]$, and is the learning target in this section. As mentioned in Section 4.4, the PDFA A defines a class of stochastic stringsets of which f_A is one. Learning f_A comes down to learning the ρ and α functions. PDFA A has 16 parameters, all necessary to fully specify ρ and α. Table 1 summarizes these values.

TABLE 1

Table 1. The parameter values of PDFA A of Figure 1.

7.2. Learning Algorithms

To see how well MLNs can learn the stochastic stringset defined by A, we generated samples of words from A to use as training data.

We fed these training samples to two learning algorithms. One algorithm is the one mentioned in section 4, which uses the structure of A to find parameters that yield the MLE with respect to the family of stochastic distributions that A defines (see de la Higuera, 2010 for details). The other algorithm takes a MLN with formulas that are intended to mimic the structure of A, and finds the weights that produce the MLE with respect to the family of stochastic distributions this MLN defines.

In natural language processing, the first approach is usually implemented in a way that incorporates smoothing (Chen and Goodman, 1999); the latter refers to a variety methods that assign nonzero probability to all possible strings, in an attempt to yield better learning outcomes when the training data size is small. This option is not adopted here since the emphasis of the present analysis is not on performance on varying training data size, but rather on comparing qualitatively the performance of a MLN with a conventional model to the standard method of obtaining the MLE of a given PDFA.

The formulas in the MLN included logical statements in the form given in Section 6 for Strictly 2-Local grammars, in addition to statements related the beginnings and endings of words. We assumed that predicates initial and final can only occur on word-edges. Therefore, this MLN was developed with signature 〈𝔇; ⊲, R_a, R_b, R_c, R_initial, R_final〉. As such, the MLN contained 16 FO statements, each of which correspond to a parameter of A. The complete .mln file is given in the Appendix.

7.3. Evaluation Method

The models output by these learning algorithms were compared in two ways: by comparing the probabilities of subsquent symbols directly in the trained models and by calculating the perplexity the models give to a test set.

For the first comparison, we converted the weights obtained in the MLN model into interpretable parameter values for A. Generally, whenever analyzing MLNs, one should avoid the computation of the partition function Z through (1) whenever possible. One way for doing that is to find sets of conditional events that are mutually exclusive and collectively exhaustive (sum to one), and then look at the ratio of the probabilities of those conditional events.

For instance, suppose we are given two constants x and y; then P(b(y)|a(x), adjacent(x, y)) corresponds to ρ(a, b). We denote ${{S}}_{ab}$ the world in which a(x) = 1, b(y) = 1, adjacent(x, y) = 1, and zero is assigned to all other ground atoms. It follows that

$\begin{array}{l}\text{P}({{S}}_{ab})=\frac{\rho (a,b)}{\text{P}(\text{a}(x),\text{adjacent}(x,y))}\end{array}$

Let $F_{\sigma {\sigma }^{\prime }}=\mathtt{\text{adjacent}}(x,y)\wedge \sigma (x)\wedge {\sigma }^{\prime }(y)$ and denote $w_{\sigma {\sigma }^{\prime }}$ its weight. Let σ range over the predicates {a, b, c, initial}, and σ′ range over {a, b, c, final}. Then let ${{S}}_{\sigma {\sigma }^{\prime }}$ be the structure of size two, for which $F_{\sigma {\sigma }^{\prime }}$ is true. According to Equation (3), the probability that the MLN assigns to ${{S}}_{\sigma {\sigma }^{\prime }}$ is

$\begin{array}{l}\mathrm{\text{P}}({{S}}_{\sigma {\sigma }^{\prime }})=\frac{\mathrm{\text{exp}}{\displaystyle {\sum }_{\sigma {\sigma }^{\prime }}}{w}_i{n}_{F_{\sigma {\sigma }^{\prime }}}({{S}}_{\sigma {\sigma }^{\prime }})}{Z}\end{array}$

We want to determine ρ(a, a), ρ(a, b), ρ(a, c), and ρ(a, ⋉). These must sum to one. Observe that the ratio $\frac{\rho (a,a)}{\rho (a,b)}=\frac{\mathrm{\text{P}}({{S}}_{aa})}{\mathrm{\text{P}}({{S}}_{ab})}$ and

$\begin{array}{l}\frac{\text{P}({{S}}_{aa})}{\text{P}({{S}}_{ab})}=\frac{\frac{1}{Z}\text{exp}({\displaystyle {\sum }_{\sigma {\sigma }^{\prime }}}{w}_{aa}{n}_{F_{aa}}({{S}}_{aa}))}{\frac{1}{Z}\text{exp}({\displaystyle {\sum }_{\sigma {\sigma }^{\prime }}}{w}_{ab}{n}_{F_{ab}}({{S}}_{ab}))}\\ =\frac{\text{exp}({\displaystyle {\sum }_{\sigma {\sigma }^{\prime }}}{w}_{aa}{n}_{F_{aa}}({{S}}_{aa}))}{\text{exp}({\displaystyle {\sum }_{\sigma {\sigma }^{\prime }}}{w}_{ab}{n}_{F_{ab}}({{S}}_{ab}))}& (4)\end{array}$

Notice that ${{S}}_{aa}$ has one true grounding only in F_aa, and zero true grounding in all other formulas. Similarly, the world ${{S}}_{ab}$ has one true grounding only in F_ab and zero true grounding in all other formulas. Consequently, the ratio of the probabilities equals the ratio of the exponential of the weights of corresponding satisfied formulas, namely

$\begin{array}{l}\frac{\rho (a,a)}{\rho (a,b)}=\frac{\text{P}({{S}}_{aa})}{\text{P}({{S}}_{ab})}=\frac{\text{exp}({\displaystyle {\sum }_{\sigma {\sigma }^{\prime }}}{w}_{aa}{n}_{F_{aa}}({{S}}_{aa}))}{\text{exp}({\displaystyle {\sum }_{\sigma {\sigma }^{\prime }}}{w}_{ab}{n}_{F_{ab}}({{S}}_{ab}))}=\frac{\text{exp}(w_{aa})}{\text{exp}(w_{ab})}\end{array}$

Thus ρ(a, a) is expressed directly in terms of ρ(a, b). Calculating all such ratios and considering the fact that ρ(a, a) + ρ(a, b) + ρ(a, c) + ρ(a, ⋉) = 1 provides a solvable system of equations.

The second method examined the perplexity of a data set. Perplexity is a measure of model performance utilized in natural language processing (Jurafsky and Martin, 2008). It is an information theoretic measure of how well a model predicts the next symbol given the previous symbols. If P_M(σ_i∣σ₁, …, σ_i−1) denotes the probability that model M assigns to the ith symbol given the previous i−1 symbols in the string, then the perplexity of M is given by

$\begin{array}{ll}{2}^{-\frac{1}{n}{\Sigma }_{i=1}^n{\text{log}}_2{P}_M({\sigma }_i\mid {\sigma }_1,\dots ,{\sigma }_{i-1})}& (5)\end{array}$

Low perplexity is an indication of model prediction accuracy.

7.4. Training Data

The training data was randomly generated with the PDFA A in Figure 1. In other words, strings were drawn i.i.d. according to the probability distribution over Σ* that A represents, which is the standard procedure for generating training data for learning PDFAs (de la Higuera, 2010; Sicco Verwer and Eyraud, 2014). We considered three different sizes of training data: 20, 50, and 100 strings. We generated training data of different sizes because we are also interested in performance on small data sets. For each size, we generated 10 different datasets so we could aggregate results across them. As we will see in the next section, we found that this range of sizes in the training data was sufficient to show that MLEs and trained MLNs behave similarly, especially with 100 strings in the training data set.

Before training the MLN, each training set had to be translated to a knowledge database (see Section 6). This entailed listing successor relations between adjacent nodes, along with the labels of the nodes. The strings in the training set were augmented with initial and final positions, so that a string abc was represented as

$\begin{array}{l}\{\text{initial}(A),\text{a}(B),\text{b}(C),\text{c}(D),\text{final}(E),\\ \text{adjacent}(A,B),\text{adjacent}(B,C),\text{adjacent}(C,D),\\ \text{adjacent}(D,E)\}\end{array}$

7.5. Results and Discussion

Table 2 summarizes the results for each training sample of size N. The parameter values shown are averages obtained from randomly generating 10 samples of size N and running the learning algorithms on each sample. After each run of a learning algorithm, a test set of 10 test strings was generated by A and the perplexity of the learned model was calculated. This was done 1,000 times and these perplexity values were averaged.

TABLE 2

Table 2. Mean parameter values and perplexity obtained by the two learning algorithms on the training sets. Standard deviations are shown in parentheses.

The results of Table 2 confirm that a MLN with formulas that instantiate the logical structure of a Strictly 2-Local stringset behaves similarly to a bigram model. The parameter values and perplexity scores across the two models are similar. In fact, the trained MLN behaves like a smoothed bigram model since every parameter has nonzero values. This is likely due to the Gaussian prior used for the weights.

Thus, MLNs can mimic the behavior of standard language models. The next two sections compare the effects of different representations on learning, by studying two MLNs trained on the same data sets. The formulas in one MLN are based on a conventional word model, and the formulas in the other are based on an unconventional word model. Since the only difference between the MLNs is due to the nature of the word models, any differences observed in learning outcomes can reasonably be attributed to representation.

8. Unbounded Stress Patterns

This case study compares conventional and unconventional word models in light of the problem of phonological well-formedness. It is widely accepted in phonology that in many languages the syllables of a word have different levels of prominence, evident either from acoustic cues or perceptual judgments (Chomsky and Halle, 1968; Liberman, 1975; Schane, 1979; Hayes, 1995). For example, native English speakers generally agree that the second syllable in America stands out from the rest. This type of prominence is called stress.

The position of stress in a word is predictable in many languages, and a variety of stress patterns have been described (van der Hulst et al., 2010). Learning where stress falls is therefore a problem for children acquiring their native language, for second-language learners, and for many applications, including speech synthesis and recognition.

Predictable stress patterns can be broadly divided into two categories: bounded and unbounded. In bounded patterns, the position of stress is always within some fixed distance of the beginning or end of the word. Thus all bounded patterns are SL_k where k is the number of positions from the stressed syllable to the left or right word edge. Unbounded stress patterns are not bounded.

In some languages, an important factor for predicting stress is syllable weight. Put simply, syllable weight is determined by the length of the syllable and the number of different sounds included at the end of the syllable. Usually only two weights are distinguished: light (L) and heavy (H).² Stress patterns that take syllable weight into account are quantity-sensitive. We focus on one such pattern, called Leftmost-Heavy-Otherwise-Rightmost (LHOR).

8.1. The LHOR Stress Pattern

Hayes (1995) describes four types of simple quantity-sensitive unbounded stress patterns. The pattern we study is exemplified by Kwak'wala, an indigenous language spoken on the Pacific Northwest Coast (Bach, 1975). Stress in Kwak'wala generally falls on the leftmost heavy syllable of the word. If the word has no heavy syllables, then stress falls on the rightmost light syllable. This pattern is therefore abbreviated LHOR (Leftmost-Heavy-Otherwise-Rightmost).

Let Σ = {L,H,Ĺ,$\stackrel{\prime }{\text{H}}$}. The acute accent denotes stress and L and H denote light and heavy syllables (so $\stackrel{\prime }{\text{H}}$ denotes a stressed heavy syllable). Let ${{L}}_{\mathrm{\text{LHOR}}}$ be the set of all strings that obey the LHOR pattern. These are called well-formed words. Some examples are given in Table 3.

TABLE 3

Table 3. Some well-formed words in ${{L}}_{\mathrm{\text{LHOR}}}$.

The DFA A_LHOR in Figure 2 computes the stringset ${{L}}_{LHOR}$; that is, it accepts all and only those strings which obey the LHOR pattern.

The well-formedness of a word in LHOR can be analyzed in terms of its subsequences of size 2 or smaller. The permissible and forbidden 2-subsequences in LHOR are shown in Table 4. If a word contains a single stressed syllable and does not contain any of the forbidden 2-subsequences, then it is well-formed.

TABLE 4

Table 4. 2-subsequences in LHOR (Strother-Garcia et al., 2016, Table 2).

Heinz (2014) analyzes simple unbounded stress patterns like the one above and shows that they are neither SL nor SP. LHOR cannot be SL because it is not closed under suffix substitution. While both $\stackrel{\prime }{\text{H}}$L^kL and L^kĹ belong to ${{L}}_{\mathrm{\text{LHOR}}}$, $\stackrel{\prime }{\text{H}}$L^kĹ does not. LHOR is therefore not SL for any k. Moreover, it cannot be SP because it is not closed under subsequence. LL^kĹ belongs to ${{L}}_{\mathrm{\text{LHOR}}}$ but the subsequence LL does not, so LHOR is not SP_k for any k.

Furthermore, Heinz (2014) shows that LHOR and similar patterns can be understood as the intersection of two stringsets: a Strictly 2-Piecewise one which bans the forbidden 2-subsequences and a Locally 1-Testable one which requires words to contain a stress.³ This analysis of LHOR extends similarly for other simple unbounded stress patterns.

8.2. Logical Characterizations of LHOR

Strother-Garcia et al. (2016) provide two logical characterizations of the LHOR pattern. One is based on a conventional word model and the other on an unconventional one. Of interest is the reduction in complexity of the logical formulas when the unconventional word model is adopted.

Consider the conventional Precedence Word Model 𝔐^< (Section 4.5) with Σ = {L, H, Ĺ, $\stackrel{\prime }{\text{H}}$}. The signature of 𝔐^< is thus 〈D; <, R_L, R_H, R_Ĺ, R_{$\stackrel{\prime }{\text{H}}$}〉. The LHOR pattern can be defined with formula templates F and G. Letting a, b range over Σ, we define

$\begin{array}{l}{F}_{ab}=(\exists x,y)\left[x<y\wedge R_{\text{a}}(x)\wedge R_{\text{b}}(y)\right]\\ G_a=(\exists x)\left[R_{\text{a}}(x)\right]\end{array}$

For example, strings that satisfy F_{H$\stackrel{\prime }{\text{H}}$} contain the 2-subsequence H$\stackrel{\prime }{\text{H}}$ and strings that satisfy G_{$\stackrel{\prime }{\text{H}}$} contain the symbol $\stackrel{\prime }{\text{H}}$. The set of banned subsequences in LHOR (Table 4) is B = {H$\stackrel{\prime }{\text{H}}$, $\stackrel{\prime }{\text{H}}$$\stackrel{\prime }{\text{H}}$, ĹL, ĹH, HĹ, $\stackrel{\prime }{\text{H}}$Ĺ, HĹ, ĹĹ, Ĺ$\stackrel{\prime }{\text{H}}$}. Then

$\begin{array}{l}{\phi }_{\text{LHOR}}\underset{\_}{\underset{\_}{\text{def}}}{\displaystyle \underset{v\in B}{\wedge }}\neg F_v\wedge (G_{\text{Ĺ}}\vee G_{\stackrel{\prime }{\text{H}}})\end{array}$

is true of string w iff w contains no member of B as a subsequence and it contains either Ĺ or $\stackrel{\prime }{\text{H}}$. Formula φ_LHOR is in 2-conjunctive normal form (CNF).

${{L}}_{\mathrm{\text{LHOR}}}$ is the set of all strings w whose models ${{M}}_w$ satisfy φ_LHOR.

$\begin{array}{l}{{L}}_{\text{LHOR}}=\{w\in {\Sigma }^{\ast }\mid {{M}}_w\models {\phi }_{\text{LHOR}}\}\end{array}$

The unconventional word model 𝔐 is similar to 𝔐^< with an important caveat: each domain element may belong to more than one unary relation. In other words, each position may bear multiple labels. Let Σ′ = {light, heavy, stress}. Then 𝔐 includes the unary relations R_L, R_H, R_S for light, heavy, and stress, respectively. The elements of Σ′ can be interpreted in terms of the conventional alphabet as follows:

$\begin{array}{l}{R}_{\text{L}}(x)=\left\{x\in \left\{\text{L},\stackrel{\prime }{\text{L}}\right\}\right\}\\ R_{\text{H}}(x)=\left\{x\in \left\{\text{H},\stackrel{\prime }{\text{H}}\right\}\right\}\\ R_{\text{S}}(x)=\left\{x\in \left\{\stackrel{\prime }{\text{L}},\stackrel{\prime }{\text{H}}\right\}\right\}\end{array}$

For example, if position x in a string is labeled $\stackrel{\prime }{\text{H}}$, both R_H(x) and R_S(x) are true in the unconventional model. The symbol $\stackrel{\prime }{\text{H}}$ is now a shorthand for stress and heavy. As in the case of capital and lowercase letters (Section 5), both models are used to represent the same objects (members of ${{L}}_{\mathrm{\text{LHOR}}}$). The unconventional model 𝔐 captures an important linguistic generalization that is not apparent in the conventional model: that stress is related to, but separable from, syllable weight.

The unconventional model provides a richer array of sub-structures (section 4.7) with which generalizations can be stated. Given 𝔐 and Σ′, Table 5 shows the possible sub-structures of size one, taking into account that syllables cannot be both light and heavy. The table also provides a symbol we use in this text to represent each possibility. Thus $\stackrel{\prime }{\text{H}}$ and Ĺ are fully-specified structures, while H and L represent heavy and light syllables that are unspecified for stress. Similarly, $\acute{\sigma }$ represents a stressed syllable unspecified for weight, and σ is a completely unspecified syllable.

TABLE 5

Table 5. Feature geometry for LHOR sub-structures of size 1.

Strother-Garcia et al. (2016) construct a new formula under 𝔐 that also describes LHOR exactly. Recall that every word must have at least one stressed syllable. Under 𝔐, the formula representing this fact is $G_{\acute{\sigma }}$. This structure is underspecified; it models no word in ${{L}}_{\mathrm{\text{LHOR}}}$, but is a sub-structure of both ${{M}}_{\stackrel{\prime }{\text{H}}}$ and ${{M}}_{\mathrm{\text{Ĺ}}}$.

The banned sub-structures are also simplified under 𝔐. Recall here that a stressed light is only permissible if it is the final syllable. Thus one of the banned sub-structures in the LHOR pattern is a stressed light followed by any other syllable, given by the formula F_Ĺσ. Again, this structure is underspecified. It is a sub-structure of four of the forbidden 2-subsequences in Table 4: ĹH, Ĺ$\stackrel{\prime }{\text{H}}$, ĹL, and ĹĹ.

In a word with one or more heavy syllables, the stress must fall on the leftmost heavy. Consequently, a heavy syllable may not be followed by any stressed syllable. This is represented by the formula $F_{\mathrm{\text{H}}\acute{\sigma }}$, which is a sub-structure of the remaining four forbidden 2-subsequences from Table 4: H$\stackrel{\prime }{\text{H}}$, $\stackrel{\prime }{\text{H}}$$\stackrel{\prime }{\text{H}}$, HĹ, and $\stackrel{\prime }{\text{H}}$Ĺ.

Thus, LHOR can be described with a 1-CNF formula under 𝔐,

$\begin{array}{l}{\psi }_{\text{LHOR}}=F_{\acute{\sigma }}\wedge \neg F_{\text{Ĺ}\sigma }\wedge \neg F_{\text{H}\acute{\sigma }}\end{array}$

which contrasts with the 2-CNF formula φ_LHOR under 𝔐^<.

Formula ψ_LHOR refers to sub-structures of size 2 or less, which are analogous to 2- and 1-subsequences. The unconventional word model permits a statement of the core linguistic generalizations of LHOR without referring to a seemingly arbitrary list of subsequences.

Strother-Garcia et al. (2016) point out that 1-CNF formulas are known to be learnable with less time and data than 2-CNF formulas (Valiant, 1984). They also demonstrate an algorithm that learns 1-CNF formulas exactly. The next sections compare how well MLNs can learn the LHOR pattern with the conventional and unconventional word models.

8.3. Markov Logic Networks With Conventional and Unconventional Models

Here we describe the two MLNs used in this experiment. To illustrate the differences between the conventional and unconventional models, Table 6 shows how the word L$\stackrel{\prime }{\text{H}}$L would be represented in the database files in Alchemy.

TABLE 6

Table 6. Conventional and unconventional word models for L$\stackrel{\prime }{\text{H}}$L.

The different word models also determined a different set of formulas in each of the MLNs. For the conventional word model, all possible formulas of the form F_ab = adjacent(x, y) ∧ a(x) ∧ b(y) with a, b ∈ {L,H,Ĺ,$\stackrel{\prime }{\text{H}}$} were included, as explained in Section 7. This yields 16 statements.

For the MLN with the unconventional model, if all possible formulas with two variables of the form F_ab with a, b belonging to the six sub-structures shown in Table 5 were included then there would be 36 statements. This increase occurs because positions in a string may satisfy more than one predicate.

However, we do not think it is appropriate to include them all. A sentence of the form “x < y ∧ P(x) ∧ Q(y)” can be interpreted as a prediction that position y has property Q given that position x with property P precedes it. There are three properties of interest for position y: heavy, light, or stressed. With respect to the predictor (the x position), we are interested in how individual properties (heavy, light, stressed) and how possible combinations of properties (of which there are two, heavy-stressed and light-stressed) predict the properties of y. For these reason, we only included formulas that predict one atomic property of y given the properties that may hold of position x. In other words the MLN included formulas F_ab = adjacent(x, y) ∧ a(x) ∧ b(y) with a ∈ {L,H,$\acute{\sigma }$,Ĺ,$\stackrel{\prime }{\text{H}}$} and $\mathtt{\text{b}}\in \left\{L,H,\acute{\sigma }\right\}$ where these symbols are a shorthand for the logical expressions shown in Table 5. This yielded 15 statements.

As mentioned, the LHOR pattern also requires sub-structures as indicated with formulas of type G_a. Thus for both the conventional and unconventional word models, we also included statements which require sub-structures in strings. Our initial efforts in this regard failed because Alchemy quickly runs out of memory as it converts all existential quantification into a CNF formula over all the constants in the database file. To overcome this hurdle, we instead introduced statements into the database file about each string. This work-around essentially encoded the information in the existential formula as a property of another constant in the database. If there were n strings in the database file, we included constants S₁, S₂, …S_n which represented each string. In the conventional model, predicates isString(x), hasLstr(x), and hasHstr(x) were included. These predicates declare that x is a string, x contains a light and stressed syllable, and x contains a heavy and stressed syllable, respectively. The MLN included the formula isString(x) ∧ (hasHstr(x)∨hasLstr(x)). In the unconventional word model, predicates isString(x) and hasStress(x) were included, where hasStress(x) states that string x has a stressed syllable. The MLN included the formula isString(x) ∧ hasStress(x).

The .mln files of both the conventional and unconventional model for the stress example can be found in the Appendix.

8.4. Training Data

We generated data sets in six sizes: 5, 10, 20, 50, 100, and 250 strings. For each size, we generated ten different datasets. We generated training data of different sizes because we were also interested in how well the MLNs generalized from small data sets.

To generate a training data set, we first randomly generated strings from length one to five inclusive from the alphabet Σ = {H, L}. As a second step, we assigned stress to the correct syllable based on the LHOR pattern. These strings were then translated into a training database file for the MLN based on its word model.

Table 7 reports the runtime of the weight-learning algorithm for both MLNs with the conventional and unconventional models, over 5, 10, 20, 50, 100, and 250 strings. Unsurprisingly, the runtime for the unconventional models was slightly shorter than for the conventional models, since the unconventional models contained one less statement.

TABLE 7

Table 7. Runtime of learning weights for linguistic statements.

8.5. Evaluation Method

Two types of evaluations were conducted to address two questions. Did the MLNs plausibly learn the LHOR pattern and how much data was necessary to learn it?

First, to evaluate whether the MLNs correctly identified the LHOR pattern, we conducted an analysis of the trained models. Similar to Section 7, we find conditional events whose probabilities sum to one, identify their ratios, and solve for the probabilities of four structures which represent the generalizations of interest. These generalizations are shown below (cf. ψ_LHOR).

(G1) No syllables follow stressed light syllables.

(G2) No stressed syllable follows a heavy syllable.

(G3) There is at least one stressed syllable.

(G4) There is at most one stressed syllable.

We elaborate on the analysis for G2; the analyses for the rest is similar. For the conventional model, let two constants (positions) A and B be given, and consider the following conditional probabilities.

$\begin{array}{l}{\text{P}}_1=\text{P}(\acute{\text{H}}(B)\mid \text{H}(A),\text{follows}(A,B))\\ {\text{P}}_2=\text{P}(\acute{\text{L}}(B)\mid \text{H}(A),\text{follows}(A,B))\\ {\text{P}}_3=\text{P}(\text{L}(B)\mid \text{H}(A),\text{follows}(A,B))\\ {\text{P}}_4=\text{P}(\text{H}(B)\mid \text{H}(A),\text{follows}(A,B))\end{array}$

These probabilities are all disjoint and sum to one i.e., P₁ + P₂ + P₃ + P₄ = 1. The probability of P₁ is given explicitly as

$\begin{array}{l}{\text{P}}_1=\frac{\text{P}(\acute{\text{H}}(B),\text{H}(A),\text{follows}(A,B))}{\text{P}(\text{H}(A),\text{follows}(A,B))}\end{array}$

Probabilities P₂, P₃, and P₄ are calculated similarly. Let ${\mathrm{\text{P}}}_1^{{{S}}_1}=\mathrm{\text{P}}(\mathtt{\text{H}}(A),\mathtt{\text{follows}}(A,B))$; this is the probability of the world ${{S}}_1$:

$\begin{array}{c}{{S}}_1=\{\text{H}(A)\wedge \text{follows}(A,B)\wedge \acute{\text{H}}(B)\wedge \neg \acute{\text{L}}(A)\wedge \neg \acute{\text{H}}(A)\wedge \neg \text{H}(B)\\ \wedge \neg \text{L}(B)\wedge \neg \text{L}(A)\wedge \neg \acute{\text{L}}(B),\neg \text{follows}(B,A)\}\end{array}$

Worlds S₂, S₃, S₄ (with probabilities ${\mathrm{\text{P}}}_2^{{{S}}_2}$, ${\mathrm{\text{P}}}_3^{{{S}}_3}$, ${\mathrm{\text{P}}}_4^{{{S}}_4}$) can be defined for P₂, P₃, P₄ respectively, in the similar way. Given two syllables, it is obvious that P₁ + P₂ is the probability that a stressed syllable comes after H(A), which we denote $\mathrm{\text{P}}(\mathtt{\text{H}}\acute{\sigma })$. Likewise, P₃ + P₄ is the probability that an unstressed syllable comes after H(A), which we denote $\mathrm{\text{P}}(\mathtt{\text{H}}\neg \acute{\sigma })$. We also know $\mathrm{\text{P}}(\mathtt{\text{H}}\acute{\sigma })+\mathrm{\text{P}}(\mathtt{\text{H}}\neg \acute{\sigma })=1$. Thus we can compare $\mathrm{\text{P}}(\mathtt{\text{H}}\acute{\sigma })$ and $\mathrm{\text{P}}(\mathtt{\text{H}}\neg \acute{\sigma })$, using N to denote the number of formulas, w_i the weight for formula F_i, and $n_i({{S}}_i)$ the number of true groundings of formula F_i in world ${{S}}_i$:

$\begin{array}{l}\frac{\text{P}(\text{H}\acute{\sigma })}{\text{P}(\text{H}\neg \acute{\sigma })}=\frac{{\text{P}}_1^{{{S}}_1}+{\text{P}}_2^{{{S}}_2}}{{\text{P}}_3^{{{S}}_3}+{\text{P}}_4^{{{S}}_4}}=\frac{{\displaystyle {\sum }_{j=1}^2}\text{exp}\left(\frac{{\displaystyle {\sum }_{i=1}^N}{w}_i{n}_i({{S}}_j)}{Z}\right)}{{\displaystyle {\sum }_{j=3}^4}\text{exp}\left(\frac{{\displaystyle {\sum }_{i=1}^N}{w}_i{n}_i({{S}}_j)}{Z}\right)}\\ =\frac{{\displaystyle {\sum }_{j=1}^2}\text{exp}\left({\displaystyle {\sum }_{i=1}^N}{w}_i{n}_i({{S}}_j)\right)}{{\displaystyle {\sum }_{j=3}^4}\text{exp}\left({\displaystyle {\sum }_{i=1}^N}{w}_i{n}_i({{S}}_j)\right)}\end{array}$

The closer this ratio is to zero, the higher the confidence on the statement that the MLN has learned (G2) that “No stressed syllable follows a heavy syllable.”

The analysis of the MLNs based on both the conventional and unconventional models proceeds similarly.

Our second evaluation asked how much training is needed for each model to reliably learn the generalizations. Here we tested both models on small training samples. Specifically, we conducted training and analysis on 10 sets of 10 training examples and 10 sets of 5 training examples.

Prior to running the models, we arbitrarily set a threshold of 0.05. If the ratios calculated with the weights of the trained model were under this threshold, we concluded the model acquired the generalizations successfully. Otherwise, we concluded it failed. We then measured the proportion of training sets on which the models succeeded.

8.6. Results

Given a training sample with 100 examples, the resultant ratios representing each generalization for the MLNs instantiating the conventional and unconventional word models are presented in Table 8. Three ratios are presented for G4 because two stressed syllables can occur in one of four ways: a stressed syllable follows $\stackrel{\prime }{\text{H}}$, a stressed syllable precedes $\stackrel{\prime }{\text{H}}$, a stressed syllable precedes Ĺ, or a stressed syllable follows Ĺ. The last case is already included in G1 (No syllable follows Ĺ), so the other three ratios are presented.

TABLE 8

Table 8. Summary of ratios from one training sample with 100 examples.

Both MLNs assign small values to these ratios, which indicate that they successfully learned the generalizations given 100 training examples. However, in most cases, the unconventional model generalized better.

With respect to the question of how much data was required to learn the LHOR pattern, we conclude that MLNs using unconventional word representations, like the one posited here, require less training data in order to generalize successfully. On sets with 5 training strings, the MLN based on the conventional model learned the generalizations on 3 out of the 10 sets. On the other hand, the MLN based on the unconventional model learned the generalizations on 9 out of the 10 sets. On sets with 10 training strings, the MLN based on the conventional model learned the generalizations on 6 out of the 10 sets. The MLN based on the unconventional model learned the generalization on all 10 sets.

9. Robotic Planning

Unconventional word models can potentially reduce the planning complexity of cooperative groups of heterogeneous robots (i.e., groups of two or more robots with non-identical functionality). In such a system, robots interact to perform tasks that would be impossible for any single agent to complete in isolation. Attempting to account for all different possible interactions, the representative DFA generated by classical automata operations is typically large. In this section, it is demonstrated that unconventional word models may provide compact interaction representations and permit computational savings, both in planning, but primarily in learning these models.

9.1. Planning Case Study

Consider a heterogeneous robotic system consisting of two vehicles: a ground vehicle (referred to as the crawler) and an aerial vehicle (referred to as the quadrotor). These two vehicles are able to operate independently, in isolation, or can be connected together by a flexible tether. The quadrotor is also able to perch on a flat surface, and use the latter as an anchor point when tethered to the crawler. Once the perching occurs, the crawler is able to reel in the tether, allowing for traversal of obstacles in order to reach a desired location (Figure 5). It is assumed that the crawler cannot traverse certain obstacles in its environment, such as a steep hill, without an applying force to the anchored tether.

FIGURE 5

Figure 5. The heterogeneous robotic system considered in this section. The two robots can latch onto each other by means of a powered spool mechanism. By positioning itself on the other side of the fence, the quadrotor can act as an anchor point for the crawler, which will use its powered spool to reel itself up and over the fence to reach the other side. (A) the quadrotor lands in front of the ground vehicle; (B) the tip of the ground vehicle's spool attaches to the quadrotor's velcro apron; (C) the quadrotor takes off to fly over the fence, tethered on the ground vehicle which lets the line real out; (D) the quadrotor lands on the other side of the fence; (E) the ground robot uses its powered spool to reel in the line and climb vertically against the fence; (F) the ground robot has made it over the fence and is on its way to the soft landing area on the other side of the fence.

The primary motivation in using an unconventional word model is enabling the heterogeneous system to autonomously traverse a variety of otherwise insurmountable obstacles (e.g., the fence in Figure 5) after a small amount of training. The training data in this case would be a human operator manually controlling the quadrotor and crawler to allow the latter to climb over the fence using its spool. Using operator coordinating decisions as data, the system learns which action sets are most likely to result in the crawler reaching its goal position. Another potential benefit of the unconventional model is a reduction in the calculation times which allow for the automated planner to better determine the best course of action in real time.

Table 9 shows the alphabet used for the conventional model, and the corresponding properties that become the unary relations in the unconventional model. Overall, these properties encode three separate pieces of information: the vehicle under concern (crawler/quad), the motion it makes (move/stop), and whether it is tethered, untethered, or attaching. Note that attach only co-occurs with crawler and move.

TABLE 9

Table 9. Feature geometry for each state of the heterogeneous multi-robot system of Figure 5.

The grammar for the cooperative robot behavior is created based on three assumptions: (i) two vehicles cannot move at the same time — one has to stop for the other to start, (ii) the crawler is tethered to the quadrotor after attach, and (iii) the strings have to start with move and end with stop. Based on these assumptions, the DFA of Figure 6 is constructed, whose underlying structure is Strictly 2-Local. Transitions in the diagram are unlabeled because, as in Section 7, all transitions are of the form δ(q, σ) = σ. Similarly to the strings in Section 7, strings obtained from this DFA are also augmented with initial (⋊) and final (⋉).

FIGURE 6

Figure 6. The automaton that accepts strings of robot actions, along cooperative plans in which one robot moves at any given time instant.

To illustrate, the similarity and differences between the conventional and unconventional models, Table 10 shows how the string abtBCD would be represented in each of the database files.

TABLE 10

Table 10. Conventional and unconventional word models consistent with the word (plan) abtBCD.

The grammar of the language generated by the DFA of Figure 6 is expressed as a list of forbidden 2-factors in Table 11. In this table, we only listed unique 2-factors for the conventional model, even though one 2-factor in the unconventional one might correspond to several forbidden 2-factors in the conventional model. For example, both untethered-tethered and move-move forbid the substring aA, but it is only listed for untethered-tethered.

TABLE 11

Table 11. Forbidden 2-factors constituting the strictly 2-Local grammar for the cooperative behavior of the heterogeneous robotic system of Figure 5, under the Conventional and Unconventional Word Models.

9.2. Markov Logic Networks With Conventional and Unconventional Models

The formulas in the MLN with the conventional model included the statements like those presented in Section 6 for Strictly 2-Local grammars, in addition to statements with initial and final as in Section 7. This resulted in a total of 99 statements. The .mln file, which lists all these statements, is given in the Appendix.

For the unconventional model, the formulas can be categorized into three types as listed below, yielding a total of 39 statements. These statements were selected based on our own knowledge that the tether features do not interact with the vehicle and motion features, but that vehicle and motion features do interact, as only one vehicle was allowed to move at any point. Thus, the statements are (i) 9 FO statements involving the tether features {tethered, untethered, attach}, (ii) 16 FO statements involving combinations of motion and vehicle features, and (iii) 14 FO statements involving individual feature combined with initial and final. The .mln file with the complete list is given in the Appendix.

The runtime of the weight-learning algorithm for the robot grammar is given in Table 12. Learning weights for the unconventional model took about half the time compared to doing the same for the conventional model.

TABLE 12

Table 12. Runtime for learning weights for robotic statements.

9.3. Training Data

We generated strings for the training data-set, assuming that all transitions have the same probability. We considered training data sets of 5, 10, 20, 50, 100, and 250 strings. For each of the data sets of size 5 and 10, we generated 10 files. Due to the significantly longer list of statements that Alchemy had to assign weights to (and consequently longer runtime for training), we did not train it on multiple files of sizes 20, 50, 100, and 250.

9.4. Evaluation Method and Results

The learning outcomes under the conventional and unconventional MLN models on 20 training strings are presented in Tables 13, 14, respectively. For instance, the entry in row a and column b expresses the conditional probability P(b(x)|a(x), adjacent(x, y)), which corresponds to ρ(a, b) in the associated PDFA of Figure 6. We introduced a threshold of 0.05 for the probability of allowed bi-grams. The allowed bi-grams (based on the threshold) are shaded in the table.

TABLE 13

Table 13. Conventional model trained on 20 training strings.

TABLE 14

Table 14. Unconventional model trained on 20 training strings.

These results indicate that both models meet this benchmark of success with 20 training strings. Generally, however, the unconventional model provides higher probabilities to licit sequences.

To evaluate how much training is needed for each model to reliably generalize, we tested both models on small training samples. Specifically, we tested both models on ten training sets with 10 strings and ten training sets with 5 strings. On sets with 5 training strings, the trained MLN with the conventional model learns the correct grammar on 1 set out of 10. The trained MLN with the unconventional model learns the correct grammar list on 6 sets out of 10. On sets with 10 training strings, conventional models learn the correct grammar only on 4 sets out of 10. The unconventional model learns the correct grammar on 9 sets out of 10.

The empirical conclusions from this case study are in agreement with those of Section 8: MLNs trained with unconventional models seem to require less training data to converge. Additionally, the computation time required by the unconventional model is far smaller than that of the conventional one, since the former featured a significantly more compact representation.

10. Discussion

This article has applied statistical relational learning to the problem of inferring categorical and stochastic formal languages, a problem typically identified with the field of grammatical inference. The rationale for tackling these learning problems with relational learning is that the learning techniques separate issues of representation from issues of inference. In this way, domain-specific knowledge can be incorporated into the representations of strings when appropriate.

Our case studies indicate that not only can MLNs mimic traditional n-gram language models, but that successful inference with unconventional word models, which permit multiple positions in strings to share properties, concretely improve inference. This is because with the richer representations unconventional models provide, fewer formulas in the MLN are necessary to instantiate a sufficiently expressive parametric model as compared to the representations provided by conventional models. Two important consequences of this are a reduction in the training time and a reduction in the amount of data required to generalize successfully. These results were demonstrated in different domains, phonology and robotics.

In addition to exploring learning with unconventional models in these domains and others, there are four other important avenues for future research.

While this article considered the learning problem of finding weights given formula, another problem is identifying both the formulas and the weights. In this regard, it would be interesting to compare the learning of stochastic formal languages with statistical relational learning methods where the formulas are not provided a priori to their learning with grammatical inference methods such as ALEGRIA (de la Higuera, 2010).

Second, is the problem of scalability. Unless the input files to Alchemy 2 were small, this software required large computational resources in terms of time and memory. Developing better software and algorithms to allow MLNs to scale is essential to moving from the examples presented here to more complex real-world applications. We suspect that MLNs instantiated by formulas of the type discussed in this paper can be brought to scale. This is because the notion of sub-structure which underlies these methods provides a generality relation which structures the hypothesis space and thus significantly cuts down the computational resources required (De Raedt, 2008). Studying how to integrate this inference structure into MLNs with the right properties would be a worthwhile endeavor.

Third, Section 7.3 introduces a way to translate the weights on the formulas in the MLN to probabilities on the transitions in a PDFA. A welcome theoretical result would be to establish the general conditions and algorithmic procedure under which this translation can occur and be computed automatically.

Finally, while the case studies in this article are experimental, we believe that general theoretical results relating relational learning, grammatical inference, unconventional word models, and formal languages are now within reach. We hope that the present paper spurs such research activity.

Author Contributions

MV developed the training data and the MLNs used in sections 7–9. AZ conducted the analysis of the results in sections 7–9. Everyone contributed equally to the design of the experiments in sections 7–9. JH, HT, and KS-G drafted section 1; JH sections 2, 4; HT and JH sections 3 and 5; MV section 6; AZ, MV, and JH section 7; KS-G, MV, AZ, and JH section 8; HT, MS, MV, AZ and JH section 9; and JH section 10. Everyone helped revise the initial draft.

Funding

This research is supported by NIH R01HD087133-01 to HT and JH.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Footnotes

1. ^Model signatures may also include constants, but we leave out this term for two reasons. First, within model theory, constants are often treated as functions which take zero arguments. Second, the term constant has a different meaning in the statistical relational learning literature. There, constants are understood as domain elements which ground formulas.

2. ^Syllable weights, and in fact stress itself, manifest differently in different languages. We abstract away from this fact.

3. ^The latter stringset equals Σ*ĹΣ*∪Σ*$\stackrel{\prime }{\text{H}}$Σ*.

References

Bach, E. W. (1975). “Long vowels and stress in Kwakiutl,” in Texas Linguistic Forum, Vol. 2 (Austin, TX), 9–19.

Google Scholar

Büchi, J. R. (1960). Weak second-order arithmetic and finite automata. Math. Logic Q. 6, 66–92.

Google Scholar

Carrasco, R. C. and Oncina, J. (1994). “Learning stochastic regular grammars by means of a state merging method,” in Proceedings of Grammatical Inference and Applications, Second International Colloquium, ICGI-94 (Alicante), 139–152.

Google Scholar

Carrasco, R. C., and Oncina, J. (1999). Learning deterministic regular grammars from stochastic samples in polynomial time. RAIRO Theor. Inf. Appl. 33, 1–20.

Google Scholar

Chen, S. F., and Goodman, J. (1999). An empirical study of smoothing techniques for language modeling. Comp. Speech Lang. 13, 359–394.

Google Scholar

Chomsky, N., and Halle, M. (1968). The Sound Pattern of English. New York, NY: Harper & Row Inc.

Google Scholar

Clark, A., and Lappin, S. (2011). Linguistic Nativism and the Poverty of the Stimulus. Wiley-Blackwell.

Google Scholar

de la Higuera, C. (2010). Grammatical Inference: Learning Automata and Grammars. Cambridge, UK: Cambridge University Press.

Google Scholar

De Raedt, L. (2008). Logical and Relational Learning. Berlin; Heidelberg: Springer-Verlag.

Google Scholar

De Raedt, L., Kersting, K., Natarajan, S., and Poole, D. (2016). Statistical Relational Artificial Intelligence: Logic Probability and Computation. San Rafael, CA: Morgan and Claypool.

Google Scholar

Domingos, P., and Lowd, D. (2009). Markov logic: an interface layer for artificial intelligence. Synth. Lect. Artif. Intell. Mach. Learn. 3, 1–155. doi: 10.2200/S00206ED1V01Y200907AIM007‘

CrossRef Full Text | Google Scholar

Droste, M., and Gastin, P. (2009). “Weighted automata and weighted logics,” in Handbook of Weighted Automata, Monographs in Theoretical Computer Science, eds M. Droste, W. Kuich, and H. Vogler (Berlin: Springer), 175–211.

Google Scholar

Enderton, H. B. (2001). A Mathematical Introduction to Logic, 2nd Edn. San Diego, CA: Academic Press.

Google Scholar

Fu, J., Tanner, H. G., Heinz, J., Karydis, K., Chandlee, J., and Koirala, C. (2015). Symbolic planning and control using game theory and grammatical inference. Eng. Appl. Artif. Intell. 37, 378–391. doi: 10.1016/j.engappai.2014.09.020

CrossRef Full Text | Google Scholar

García, P., and Ruiz, J. (2004). Learning k-testable and k-piecewise testable languages from positive data. Grammars 7, 125–140.

Google Scholar

García, P., Vidal, E., and Oncina, J. (1990). “Learning locally testable languages in the strict sense,” in Proceedings of the Workshop on Algorithmic Learning Theory (Tokyo), 325–338.

Google Scholar

Getoor, L., and Taskar, B. (2007). Introduction to Statistical Relational Learning. Cambridge, MA: MIT press.

Google Scholar

Gold, E. (1967). Language identification in the limit. Inform. Control 10, 447–474.

Google Scholar

Hayes, B. (1995). Metrical Stress Theory: Principles and Case Studies. Chicago, IL: University of Chicago Press.

Google Scholar

Heinz, J. (2010). “String extension learning,” in Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (Uppsala), 897–906.

Google Scholar

Heinz, J. (2014). “Culminativity times harmony equals unbounded stress,” in Word Stress: Theoretical and Typological Issues, ed H. van der Hulst (Cambridge: Cambridge University Press), 255–276.

Google Scholar

Heinz, J. (2016). “Computational theories of learning and developmental psycholinguistics,” in The Oxford Handbook of Developmental Linguistics, eds J. Lidz, W. Synder, and J. Pater (Oxford: Oxford University Press), 633–663.

Google Scholar

Heinz, J., de la Higuera, C., and van Zaanen, M. (2015). Grammatical Inference for Computational Linguistics. San Rafael, CA: Morgan and Claypool.

Google Scholar

Heinz, J., Kasprzik, A., and Kötzing, T. (2012). Learning with lattice-structured hypothesis spaces. Theor. Comput. Sci. 457, 111–127. doi: 10.1016/j.tcs.2012.07.017

CrossRef Full Text | Google Scholar

Heinz, J., and Rogers, J. (2013). “Learning subregular classes of languages with factored deterministic automata,” in Proceedings of the 13th Meeting on the Mathematics of Language (MoL 13) (Sofia), 64–71.

Google Scholar

Heinz, J., and Sempere, J. (eds.). (2016). Topics in Grammatical Inference. Berlin; Heidelberg: Springer-Verlag.

Google Scholar

Hodges, W. (1993). Model Theory. Cambridge, UK: Cambridge University Press.

Google Scholar

Hopcroft, J. E., and Ullman, J. D. (1979). Introduction to Automata Theory, Languages, and Computation. Reading, MA: Addison-Wesley.

Google Scholar

Jain, S., Osherson, D., Royer, J. S., and Sharma, A. (1999). Systems That Learn: An Introduction to Learning Theory (Learning, Development and Conceptual Change), 2nd Edn. Cambridge, MA: The MIT Press.

Google Scholar

Jurafsky, D., and Martin, J. (2008). Speech and Language Processing: An Introduction to Natural Language Processing, Speech Recognition, and Computational Linguistics, 2nd Edn. Upper Saddle River, NJ: Prentice-Hall.

Google Scholar

Karydis, K., Poulakakis, I., and Tanner, H. G. (2015). Probabilistically valid stochastic extensions of deterministic models for systems with uncertainty. Int. J. Robot. Res. 34, 1278–1295. doi: 10.1177/0278364915576336

CrossRef Full Text | Google Scholar

Kiener, J., and von Stryk, O. (2007). “Cooperation of heterogeneous, autonomous robots: A case study of humanoid and wheeled robots,” in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (San Diego, CA), 959–964.

Google Scholar

Kornai, A. (2007). “Advanced information and knowledge processing,” in Mathematical Linguistics (London: Springer Verlag).

Google Scholar

Kracht, M. (2003). The Mathematics of Language. Berlin: Mouton de Gruyter.

Google Scholar

Kress-Gazit, H., Fainekos, G. E., and Pappas, G. J. (2009). Temporal-logic-based reactive mission and motion planning. IEEE Trans. Robot. 25, 1370–1381. doi: 10.1109/TRO.2009.2030225

CrossRef Full Text | Google Scholar

Liberman, M. Y. (1975). The intonational system of English. PhD thesis, Massachusetts Institute of Technology.

Google Scholar

Libkin, L. (2004). Elements of Finite Model Theory. Berlin: Springer.

Google Scholar

Lothaire, M. editor (1997). Combinatorics on Words. Cambridge; New York, NY: Cambridge University Press.

Google Scholar

Lothaire, M. editor (2005). Applied Combinatorics on Words, 2nd Edn. Cambridge University Press.

Google Scholar

McNaughton, R., and Papert, S. (1971). Counter-Free Automata. Cambridge, MA: MIT Press.

Google Scholar

Mellinger, D., Shomin, M., Michael, N., and Kumar, V. (2013). “Cooperative grasping and transport using multiple quadrotors,” in Distributed Autonomous Robotic Systems, Vol. 83 of Springer Tracts in Advanced Robotics, eds A. Martinoli, F. Mondada, N. Correll, G. Mermoud, M. Egerstedt, M. A. Hsieh, L. E. Parker, and K. Støy (Berlin; Heidelberg: Springer), 545–558.

Google Scholar

Mohri, M. (2005). “Statistical natural language processing,” in Applied Combinatorics on Words, ed M. Lothaire (New York, NY: Cambridge University Press), 210–240.

Google Scholar

Natarajan, S., Kersting, K., Khot, T., and Shavlik, J. (2015). Boosted Statistical Relational Learners: From Benchmarks to Data-Driven Medicine. SpringerBriefs in Computer Science. Springer.

Google Scholar

Odden, D. (2014). Introducing Phonology, 2nd Edn. Cambridge, UK: Cambridge University Press.

Google Scholar

Oncina, J., and Garcia, P. (1992). “Identifying regular languages in polynomial time,” in Advances in Structural and Syntactic Pattern Recognition, Vol. 5 of Series in Machine Perception and Artificial Intelligence (World Scientific), 99–108.

Google Scholar

Parker, L. E. (1994). Heterogeneous Multi-Robot Cooperation. PhD thesis, Massachusetts Institute of Technology.

Google Scholar

Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Francisco, CA: Morgan Kaufmann.

Google Scholar

Richardson, M., and Domingues, P. (2006). Markov logic networks. Mach. Learn. 62, 107–136. doi: 10.1007/s10994-006-5833-1

CrossRef Full Text | Google Scholar

Rogers, J., Heinz, J., Bailey, G., Edlefsen, M., Visscher, M., Wellcome, D., et al. (2010). “On languages piecewise testable in the strict sense,” in The Mathematics of Language, Vol. 6149 of Lecture Notes in Artifical Intelligence (Berlin: Springer), 255–265.

Google Scholar

Rogers, J., Heinz, J., Fero, M., Hurst, J., Lambert, D., and Wibel, S. (2013). “Cognitive and sub-regular complexity,” in Formal Grammar, Vol. 8036 of Lecture Notes in Computer Science (Berlin; Heidelberg: Springer), 90–108.

PubMed Abstract | Google Scholar

Rogers, J., and Pullum, G. (2011). Aural pattern recognition experiments and the subregular hierarchy. J. Logic Lang. Inform. 20, 329–342. doi: 10.1007/s10849-011-9140-2

CrossRef Full Text | Google Scholar

Schane, S. A. (1979). Rhythm, accent, and stress in English words. Ling. Inquiry 10, 483–502.

Google Scholar

Sicco Verwer, C. D. L. H., and Eyraud, R. (2014). Pautomac: a probabilistic automata and hidden markov models learning competition. Mach. Learn. 96, 129–154. doi: 10.1007/s10994-013-5409-9

CrossRef Full Text | Google Scholar

Strother-Garcia, K., Heinz, J., and Hwangbo, H. J. (2016). “Using model theory for grammatical inference: a case study from phonology,” in International Conference on Grammatical Inference (Delft), 66–78.

Google Scholar

Thomas, W. (1982). Classifying regular events in symbolic logic. J. Comput. Sys. Sci. 25, 370–376. doi: 10.1016/0022-0000(82)90016-2

CrossRef Full Text | Google Scholar

Thomas, W. (1997). “Chapter 7: Languages, automata, and logic,” in Handbook of Formal Languages, Vol. 3 (Berlin: Springer).

Google Scholar

Valiant, L. (1984). A theory of the learnable. Commun. ACM 27, 1134–1142. doi: 10.1145/1968.1972

CrossRef Full Text | Google Scholar

van der Hulst, H., Goedemans, R., and van Zanten, E. editors (2010). A Survey of Word Accentual Patterns in the Languages of the World. Berlin: Mouton de Gruyter.

Google Scholar

Zehfroosh, A., Kokkoni, E., Tanner, H. G., and Heinz, J. (2017). “Learning models of human-robot interaction from small data,” in Mediterranean Conference on Control and Automation (Valletta), 223–228.

Google Scholar

Appendix:

Input .mln files for Alchemy 2

ABC-strings

a(char)
b(char)
c(char)
initial(char)
final(char)
adjacent(char,char)
 
 
0 adjacent(x,y) ^ initial(x) ^ a(y)
0 adjacent(x,y) ^ initial(x) ^ b(y)
0 adjacent(x,y) ^ initial(x) ^ c(y)
0 adjacent(x,y) ^ initial(x) ^ final(y)
0 adjacent(x,y) ^ a(x) ^ final(y)
0 adjacent(x,y) ^ b(x) ^ final(y)
0 adjacent(x,y) ^ c(x) ^ final(y)
0 adjacent(x,y) ^ a(x) ^ a(y)
0 adjacent(x,y) ^ a(x) ^ b(y)
0 adjacent(x,y) ^ a(x) ^ c(y)
0 adjacent(x,y) ^ b(x) ^ a(y)
0 adjacent(x,y) ^ b(x) ^ b(y)
0 adjacent(x,y) ^ b(x) ^ c(y)
0 adjacent(x,y) ^ c(x) ^ a(y)
0 adjacent(x,y) ^ c(x) ^ b(y)
0 adjacent(x,y) ^ c(x) ^ c(y)

Unbounded Stress Pattern

Conventional Model

h(char)
l(char)
hstr(char)
lstr(char)
follows(char,char)
hasLstr(string)
hasHstr(string)
isString(string)
 
 
0 follows(x,y)^ h(x) ^ h(y)
0 follows(x,y)^ h(x) ^ l(y)
0 follows(x,y)^ h(x) ^ hstr(y)
0 follows(x,y)^ h(x) ^ lstr(y)
0 follows(x,y)^ l(x) ^ h(y)
0 follows(x,y)^ l(x) ^ l(y)
0 follows(x,y)^ l(x) ^ hstr(y)
0 follows(x,y)^ l(x) ^ lstr(y)
0 follows(x,y)^ hstr(x) ^ h(y)
0 follows(x,y)^ hstr(x) ^ l(y)
0 follows(x,y)^ hstr(x) ^ hstr(y)
0 follows(x,y)^ hstr(x) ^ lstr(y)
0 follows(x,y)^ lstr(x) ^ h(y)
0 follows(x,y)^ lstr(x) ^ l(y)
0 follows(x,y)^ lstr(x) ^ hstr(y)
0 follows(x,y)^ lstr(x) ^ lstr(y)
0 isString(x) ^ (hasLstr(x) v hasHstr(x))

Unconventional Model

follows(char,char)
h(char)
str(char)
l(char)
hasStress(string)
isString(string)
 
 
0 follows(x,y) ^ h(x) ^ str(x) ^ h(y)
0 follows(x,y) ^ h(x) ^ str(x) ^ l(y)
0 follows(x,y) ^ h(x) ^ str(x) ^ str(y)
0 follows(x,y) ^ l(x) ^ str(x) ^ h(y)
0 follows(x,y) ^ l(x) ^ str(x) ^ l(y)
0 follows(x,y) ^ l(x) ^ str(x) ^ str(y)
0 follows(x,y) ^ h(x) ^ h(y)
0 follows(x,y) ^ h(x) ^ l(y)
0 follows(x,y) ^ h(x) ^ str(y)
0 follows(x,y) ^ l(x) ^ h(y)
0 follows(x,y) ^ l(x) ^ l(y)
0 follows(x,y) ^ l(x) ^ str(y)
0 follows(x,y) ^ str(x) ^ h(y)
0 follows(x,y) ^ str(x) ^ l(y)
0 follows(x,y) ^ str(x) ^ str(y)
0 isString(x) ^ hasStress(x)

Robot Planning

Conventional Model

adjacent(char,char)
initial(char)
final(char)
a(char)
b(char)
c(char)
d(char)
a-prime(char)
b-prime(char)
c-prime(char)
d-prime(char)
t(char)
 
 
0 adjacent(x,y) ^ a(x) ^ a(y)
0 adjacent(x,y) ^ a(x) ^ b(y)
0 adjacent(x,y) ^ a(x) ^ c(y)
0 adjacent(x,y) ^ a(x) ^ d(y)
0 adjacent(x,y) ^ a(x) ^ a-prime(y)
0 adjacent(x,y) ^ a(x) ^ b-prime(y)
0 adjacent(x,y) ^ a(x) ^ c-prime(y)
0 adjacent(x,y) ^ a(x) ^ d-prime(y)
0 adjacent(x,y) ^ a(x) ^ t(y)
0 adjacent(x,y) ^ b(x) ^ b(y)
0 adjacent(x,y) ^ b(x) ^ a(y)
0 adjacent(x,y) ^ b(x) ^ c(y)
0 adjacent(x,y) ^ b(x) ^ d(y)
0 adjacent(x,y) ^ b(x) ^ a-prime(y)
0 adjacent(x,y) ^ b(x) ^ b-prime(y)
0 adjacent(x,y) ^ b(x) ^ c-prime(y)
0 adjacent(x,y) ^ b(x) ^ d-prime(y)
0 adjacent(x,y) ^ b(x) ^ t(y)
0 adjacent(x,y) ^ c(x) ^ c(y)
0 adjacent(x,y) ^ c(x) ^ a(y)
0 adjacent(x,y) ^ c(x) ^ b(y)
0 adjacent(x,y) ^ c(x) ^ d(y)
0 adjacent(x,y) ^ c(x) ^ a-prime(y)
0 adjacent(x,y) ^ c(x) ^ b-prime(y)
0 adjacent(x,y) ^ c(x) ^ c-prime(y)
0 adjacent(x,y) ^ c(x) ^ d-prime(y)
0 adjacent(x,y) ^ c(x) ^ t(y)
0 adjacent(x,y) ^ d(x) ^ d(y)
0 adjacent(x,y) ^ d(x) ^ a(y)
0 adjacent(x,y) ^ d(x) ^ b(y)
0 adjacent(x,y) ^ d(x) ^ c(y)
0 adjacent(x,y) ^ d(x) ^ a-prime(y)
0 adjacent(x,y) ^ d(x) ^ b-prime(y)
0 adjacent(x,y) ^ d(x) ^ c-prime(y)
0 adjacent(x,y) ^ d(x) ^ d-prime(y)
0 adjacent(x,y) ^ d(x) ^ t(y)
0 adjacent(x,y) ^ a-prime(x) ^ a-prime(y)
0 adjacent(x,y) ^ a-prime(x) ^ a(y)
0 adjacent(x,y) ^ a-prime(x) ^ b(y)
0 adjacent(x,y) ^ a-prime(x) ^ c(y)
0 adjacent(x,y) ^ a-prime(x) ^ d(y)
0 adjacent(x,y) ^ a-prime(x) ^ b-prime(y)
0 adjacent(x,y) ^ a-prime(x) ^ c-prime(y)
0 adjacent(x,y) ^ a-prime(x) ^ d-prime(y)
0 adjacent(x,y) ^ a-prime(x) ^ t(y)
0 adjacent(x,y) ^ b-prime(x) ^ b-prime(y)
0 adjacent(x,y) ^ b-prime(x) ^ a(y)
0 adjacent(x,y) ^ b-prime(x) ^ b(y)
0 adjacent(x,y) ^ b-prime(x) ^ c(y)
0 adjacent(x,y) ^ b-prime(x) ^ d(y)
0 adjacent(x,y) ^ b-prime(x) ^ a-prime(y)
0 adjacent(x,y) ^ b-prime(x) ^ c-prime(y)
0 adjacent(x,y) ^ b-prime(x) ^ d-prime(y)
0 adjacent(x,y) ^ b-prime(x) ^ t(y)
0 adjacent(x,y) ^ c-prime(x) ^ c-prime(y)
0 adjacent(x,y) ^ c-prime(x) ^ a(y)
0 adjacent(x,y) ^ c-prime(x) ^ b(y)
0 adjacent(x,y) ^ c-prime(x) ^ c(y)
0 adjacent(x,y) ^ c-prime(x) ^ d(y)
0 adjacent(x,y) ^ c-prime(x) ^ a-prime(y)
0 adjacent(x,y) ^ c-prime(x) ^ b-prime(y)
0 adjacent(x,y) ^ c-prime(x) ^ d-prime(y)
0 adjacent(x,y) ^ c-prime(x) ^ t(y)
0 adjacent(x,y) ^ d-prime(x) ^ d-prime(y)
0 adjacent(x,y) ^ d-prime(x) ^ a(y)
0 adjacent(x,y) ^ d-prime(x) ^ b(y)
0 adjacent(x,y) ^ d-prime(x) ^ c(y)
0 adjacent(x,y) ^ d-prime(x) ^ d(y)
0 adjacent(x,y) ^ d-prime(x) ^ a-prime(y)
0 adjacent(x,y) ^ d-prime(x) ^ b-prime(y)
0 adjacent(x,y) ^ d-prime(x) ^ c-prime(y)
0 adjacent(x,y) ^ d-prime(x) ^ t(y)
0 adjacent(x,y) ^ t(x) ^ t(y)
0 adjacent(x,y) ^ t(x) ^ a(y)
0 adjacent(x,y) ^ t(x) ^ b(y)
0 adjacent(x,y) ^ t(x) ^ c(y)
0 adjacent(x,y) ^ t(x) ^ d(y)
0 adjacent(x,y) ^ t(x) ^ a-prime(y)
0 adjacent(x,y) ^ t(x) ^ b-prime(y)
0 adjacent(x,y) ^ t(x) ^ c-prime(y)
0 adjacent(x,y) ^ t(x) ^ d-prime(y)
0 adjacent(x,y) ^ initial(x) ^ a(y)
0 adjacent(x,y) ^ initial(x) ^ b(y)
0 adjacent(x,y) ^ initial(x) ^ c(y)
0 adjacent(x,y) ^ initial(x) ^ d(y)
0 adjacent(x,y) ^ initial(x) ^ a-prime(y)
0 adjacent(x,y) ^ initial(x) ^ b-prime(y)
0 adjacent(x,y) ^ initial(x) ^ c-prime(y)
0 adjacent(x,y) ^ initial(x) ^ d-prime(y)
0 adjacent(x,y) ^ initial(x) ^ t(y)
0 adjacent(x,y) ^ a(x) ^ final(y)
0 adjacent(x,y) ^ b(x) ^ final(y)
0 adjacent(x,y) ^ c(x) ^ final(y)
0 adjacent(x,y) ^ d(x) ^ final(y)
0 adjacent(x,y) ^ a-prime(x) ^ final(y)
0 adjacent(x,y) ^ b-prime(x) ^ final(y)
0 adjacent(x,y) ^ c-prime(x) ^ final(y)
0 adjacent(x,y) ^ d-prime(x) ^ final(y)
0 adjacent(x,y) ^ t(x) ^ final(y)

Unconventional Model

adjacent(char,char)
crawler(char)
quad(char)
move(char)
stop(char)
tethered(char)
untethered(char)
attach(char)
initial(char)
final(char)
 
 
0 adjacent(x,y) ^ crawler(x) ^ move(x) ^ crawler(y) ^ move(y)
0 adjacent(x,y) ^ crawler(x) ^ move(x) ^ crawler(y) ^ stop(y)
0 adjacent(x,y) ^ crawler(x) ^ move(x) ^ quad(y) ^ move(y)
0 adjacent(x,y) ^ crawler(x) ^ move(x) ^ quad(y) ^ stop(y)
0 adjacent(x,y) ^ crawler(x) ^ stop(x) ^ crawler(y) ^ move(y)
0 adjacent(x,y) ^ crawler(x) ^ stop(x) ^ crawler(y) ^ stop(y)
0 adjacent(x,y) ^ crawler(x) ^ stop(x) ^ quad(y) ^ move(y)
0 adjacent(x,y) ^ crawler(x) ^ stop(x) ^ quad(y) ^ stop(y)
0 adjacent(x,y) ^ quad(x) ^ move(x) ^ crawler(y) ^ move(y)
0 adjacent(x,y) ^ quad(x) ^ move(x) ^ crawler(y) ^ stop(y)
0 adjacent(x,y) ^ quad(x) ^ move(x) ^ quad(y) ^ move(y)
0 adjacent(x,y) ^ quad(x) ^ move(x) ^ quad(y) ^ stop(y)
0 adjacent(x,y) ^ quad(x) ^ stop(x) ^ crawler(y) ^ move(y)
0 adjacent(x,y) ^ quad(x) ^ stop(x) ^ crawler(y) ^ stop(y)
0 adjacent(x,y) ^ quad(x) ^ stop(x) ^ quad(y) ^ move(y)
0 adjacent(x,y) ^ quad(x) ^ stop(x) ^ quad(y) ^ stop(y)
0 adjacent(x,y) ^ untethered(x) ^ untethered(y)
0 adjacent(x,y) ^ untethered(x) ^ tethered(y)
0 adjacent(x,y) ^ tethered(x) ^ untethered(y)
0 adjacent(x,y) ^ tethered(x) ^ tethered(y)
0 adjacent(x,y) ^ attach(x) ^ untethered(y)
0 adjacent(x,y) ^ untethered(x) ^ attach(y)
0 adjacent(x,y) ^ attach(x) ^ tethered(y)
0 adjacent(x,y) ^ tethered(x) ^ attach(y)
0 adjacent(x,y) ^ initial(x) ^ crawler(y)
0 adjacent(x,y) ^ initial(x) ^ quad(y)
0 adjacent(x,y) ^ initial(x) ^ move(y)
0 adjacent(x,y) ^ initial(x) ^ stop(y)
0 adjacent(x,y) ^ initial(x) ^ untethered(y)
0 adjacent(x,y) ^ initial(x) ^ tethered(y)
0 adjacent(x,y) ^ initial(x) ^ attach(y)
0 adjacent(x,y) ^ crawler(x) ^ final(y)
0 adjacent(x,y) ^ quad(x) ^ final(y)
0 adjacent(x,y) ^ move(x) ^ final(y)
0 adjacent(x,y) ^ stop(x) ^ final(y)
0 adjacent(x,y) ^ tethered(x) ^ final(y)
0 adjacent(x,y) ^ untethered(x) ^ final(y)
0 adjacent(x,y) ^ attach(x) ^ final(y)