Tagged with RegEx - Visokio Forums

SearchRegex Formula not working

JohnMR — Mon, 18 Sep 2017 06:30:00 -0400

Hi Omniscopers,

I'm trying to use Searchregex formula to pull

=searchregex("^.{3}[A-Za-z0-9 ]+\K.",[Campaing],1)

Searchregex usually works but not when I add the "\" in \K I get an error: Error with formula: Invalid text """ - an open bracket, literal number, reference or function was expected.

When I remove the slash the formula works but I need that slash in it. Why is this not working?
Thanks,
John.

Bar/Line View: Split by/Stack/Tile w/Tags & RegEx?

rng — Wed, 25 Mar 2015 09:21:39 -0400

I have stacked/tiled a view & used "tags + RegEx" (instead of unique values) to re-categorise in the view.
This works fine, but then it appears to disable 'Active' filtering?

Clicking on any of the "new" categories (stack bars) does not create brushing effects in other views like it would happen in the case of default stacking of data bars.

Text Processing: Google Analytics string aggregation/counts?

Ben_Owens — Mon, 16 Jun 2014 11:38:21 -0400

I'm currently importing web usage data from Google Analytics.

We currently have some features that pass some details in the URL (below is a very simplified example to illustrate my case)

www.mywebsite.com/fundfactsheets?ISIN=ANUMBER

So I'm getting in my data set

www.mywebsite.com/fundfactsheets?ISIN=0000001; page count 2
www.mywebsite.com/fundfactsheets?ISIN=0000002; page count 2
www.mywebsite.com/fundfactsheets?ISIN=0000003; page count 2
www.mywebsite.com/fundfactsheets?ISIN=0000004; page count 2
www.mywebsite.com/fundfactsheets?ISIN=0000005; page count 2
www.mywebsite.com/fundfactsheets?ISIN=0000006; page count 2
www.mywebsite.com/fundfactsheets?ISIN=0000007; page count 2

I really want this as aggregated data

www.mywebsite.com/fundfactsheets?ISIN* ; page count 14

I've not been able to find any regrex or way to manipulate the data within Visokio (new tool - it could be staring me in the face!!) to achieve this.

I've had a look on the forum but not seen anything there either.

Any ideas? I'm sure it will do this so any help will be gratefully received.

Text Mining: Wildcard operation + list of functions

tobasko — Fri, 02 May 2014 07:34:24 -0400

Hi everyone,

I was testing the Text Mine Operation and think that the extraction of custom entities is a very nice feature. However, is it possible to extract regular expression (RegEx) or 'wildcard' patterns, like for example: "Host * has failed"? This would extract all matching phrases/tuples like "Host A has failed", "Host B has failed", and so on?

I haven't been able to get this to work yet unfortunately. If it is not possible, is there any other way to achieve something like this?

Many thanks in advance.

Cheers,
Tobi

Idea: Text Processing - Eliminate/substitute unwanted characters within strings?

davedunckley — Tue, 29 Oct 2013 07:06:58 -0400

Hi,

Just wondering if there is a way of replacing everything within brackets in a string of text.

I have a field that has a name, then a former name within parentheses. I would like to be able to remove the ( ) and also everything within.

Example:

Smith (jones)

Should become:
Smith

as should:
(jones) Smith

Thanks in advance
Dave

New: "Search/replace" now supports RegEx and Wildcards (2.9+)

victor — Mon, 27 Jan 2014 08:02:11 -0500

The DataManager operation "Search/replace" now supports two new search modes to enable more powerful operations with fewer task entries.

You can now use wildcards (* and ? ) in the "Search for" field for a simple, yet powerful, search/replace...or you can use full-fledged Regular Expressions (RegEx) which can read and even re-write almost any text string to bring out visual and filtering patterns implicit in raw unstructured data.

The regular expression syntax and replacement patterns are the same as the ones used in the formula function REPLACEREGEX. For a complete reference of the RegEx syntax, visit http://www.regular-expressions.info/

Validation: Formulae to validate incoming value format in a field?

Barcl — Tue, 07 May 2013 07:11:51 -0400

Hi - I need to check that a field contains only values formatted in a given way. For example we have a field which should contains values with the following format:
byte 1 should be alphabetic
bytes 2-5 should be numeric
byte 6 should be alphabetic
bytes 7-10 should be numeric

In order to verify that format I created a new field with the following formula:

IF ([Codice Monitoraggio]=null,null,
LEN([Codice Monitoraggio])!=10,"lunghezza errata",
(LEFT([Codice Monitoraggio],1))<"A","Formato errato",
(LEFT([Codice Monitoraggio],1))>"Z","Formato errato",
(MID([Codice Monitoraggio], 2, 4))<"0000","Formato errato",
(MID([Codice Monitoraggio], 2, 4))>"9999","Formato errato",
(MID([Codice Monitoraggio], 6,1))<"A","Formato errato",
(MID([Codice Monitoraggio], 6,1))>"Z","Formato errato",
(MID([Codice Monitoraggio], 7, 4))<"0000","Formato errato",
(MID([Codice Monitoraggio], 7, 4))>"9999","Formato errato",
null
)

I was wandering if I can find a better way to verify those values.

Do you believe it is possible to use a JavaScript based on Regular Expressions (RegEx) with the match function? I'm not a Javascript expert... I was trying to find a PHP ereg equivalent in Java?

Thanks.

Formulae: Regex - Extracting Subset of String?

shaji_o — Tue, 09 Oct 2012 19:01:15 -0400

I've got a field that contains Product_Strategy_Message_Size_Creative Type, including the underscores. I need to extract the Message part, i.e. the string that sits between the 2nd "_" and 3rd "_". Have you got a formula that would do that for me?

Extracting text using Javascript

Guy_Cuthbert — Wed, 07 Mar 2012 06:12:18 -0500

Since 2.6, Omniscope has had the ability to include Javascript inside formulae - very useful, but potentially daunting for non-programmers. Steve did a great intro to the topic here, and I thought further examples might be useful... so here is a tutorial on how to extract selected text from a field using regular expressions...

Firstly, the use case to answer the question "Why would I want to do this?":

Omniscope users familiar with the formula language may well have come across the SEARCH and SEARCHREGEX functions, which return the position at which a particular character/phrase (in the case of SEARCH) or regular expression pattern (in the case of SEARCHREGEX). These functions are often used to extract elements of text - for example, extracting parts of a postcode; the UK postcode comprises 4 sections:

So, from a full postcode, we might want to extract the postcode area (first 1-2 characters) or the postcode district (all characters before the space). Finding the space, and extracting everything left of the space, is fairly easy using the SEARCH function, so I will focus on the trickier example of extracting the postcode area.

Using SEARCHREGEX, I can do this in Omniscope by detecting the first alpha character (i.e. A-Z) and the first numeric character (i.e. 0-9) and then extract the characters between these two extremes. To do this we would use:

DECLARE(
/* Store position of first alpha (A-Z) and first nuymeric (0-9) */
	firstAZ, SEARCHREGEX("[A-Z]",[Postcode]),
	first09, SEARCHREGEX("[0-9]",[Postcode]),
	IF(
/* Check that we found both an alpha and a numeric, and that the numeric is after the alpha i.e. a valid postcode format */
		AND(firstAZ > 0,first09 > firstAZ),
/* Extract the alpha characters, if valid */
		MID([ Postcode], firstAZ, first09-firstAZ),
/* Return nothing if postcode invalid */
		NULL
	)
)

However, regex extraction is simpler and (once we're confident in regex - lots of tutorials online) allows for far more complex extractions. So here is the same function using Javascript:

SCRIPT(`
// Declare the pattern we want to extract, and then apply it to our input text
  var re = /([A-Z]*)/;
  var m = re.exec(text1);
// We should have one (or more) groups of character sets now
  if (m == null) {
// If not, then return "No"
    'No'
  } else {
// If we do have at least one character group, return the first (could return many, concatenated, if required)
    m[0]
  }
`, "text1", [Postcode])

The structure of this is:

Firstly we have the Javascript code itself, which includes the use of a variable called "text1"
Then, in the last line, we have the declaration of "text1" (this can be called anything, and needs to be the same name here as inside the script itself, and passing the value of our [Postcode] field into this variable, for use in the script

This only scrapes the surface of this (Javascript regex) approach - there are many ways to use this as the basis for far more complex, and valuable, text extractions... but as Steve's original article demonstrates, there are many, many more uses for Javascript.

Happy scripting...