• Skip to primary navigation
  • Skip to main content
  • Skip to footer
  • EnglishEnglish
The Information Lab Netherlands

The Information Lab Netherlands

Tableau & Alteryx Software Partner

  • +31 (0) 20 261 4741
  • FREE TRIAL
  • Home
  • Tableau
    • Overview
    • Licenses
    • Creator
    • Explorer
    • Viewer
    • Desktop
    • Server
    • Online
    • Prep Builder
    • Prep Conductor
    • Tableau Embedded Analytics
  • Alteryx
    • Designer
    • Server
  • Industries
  • Data Culture
  • Training
  • Consultancy
  • Support
  • Events
  • Blog
  • About us
    • Contact
    • Team
    • Working at
      • Tableau & Alteryx Consultant

Alteryx: Text to Columns or Tokenize?

You are here: Home / Blog / All / Alteryx: Text to Columns or Tokenize?

20 February 2020 by Aline Léonard

The Tokenize is one of the four output methods of the Regular Expression tool. Thanks to this method you can specify a regular expression that will be parsed into separate columns. It can be the entire expression or a marked group and only that will be parsed.

It looks like the ‘Text To Column’ tool but Tokenize is much more powerful because you decide what you want to split!

In this set below, I want to parse the words between the dots in 3 columns.

If I use the ‘Text to Column’ tool with the dot as a delimiter, I will have this

I have a column that I don’t need with the digits.

Let’s see what would be the difference by using the Tokenize option within the ‘RegEx’ tool.

I use this RegEx expression [a-z]\w+ that will take all single character that match any word character (\w+), so it won’t capture the points and the digits.

I choose ‘Tokenize’ for the Output method and set to 3 the number of columns.

Here is the result, so exactly the 3 columns that I need

Be aware that with the Tokenize method you can only use one market group.

I highly recommend this website with this website https://regex101.com to learn and test RegEx!

You will find more info about Regex in this blogpost Using Regex to find key information from a free input text field – The Data School

Category iconAll

Recente blogposts

  • Alteryx – How to calculate the Month-over-Month growth in 3 steps
  • How to: Pattern bar chart

Footer

Stay up to date

Once per month we will send a newsletter with the latest Tableau & Alteryx tips and Tricks, and links to the most interesting content on the internet. Subscribe below.

The Information Lab Netherlands B.V.

MediArena 2
1114 BC  Amsterdam

T: +31 20 261 4741
E: info@theinformationlab.nl

Youtube channel
LinkedIn
Twitter

© 2019 The Information Lab Netherlands B.V. – Algemene Voorwaarden

We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.Ok