TensorFlow 2.0 — Feature Engineering Complexity continues

sandeep srinivasan
Oct 8 · 4 min read

Very low levels of abstraction can inhibit and delay innovation

The first time I looked at TensorFlow, it reminded me of assembly language or perhaps Fortran!
Even though these languages are powerful, due to their low abstraction level, they are also extremely tedious to program and accomplish even small tasks. This lack of abstraction can pose many challenges and barriers to rapid innovation.

The level of abstraction matters

If researchers and developers today were to write FFT (Fast Fourier Transforms) algorithms in Fortran and not use a software package such as Matlab , Mathematica or OctaveDSP chips (digital signal processors) would not be able to translate even simple words, let alone, paragraphs and music. In addition, perhaps the DSP chip, that is present in every mobile device (+Alexa , Google home etc.), would cost $5000 and not $1.50 cents .

One of the key elements that allowed the rapid innovation in the area of DSP’s over the last two decades, was the level of abstraction that Matlab, Mathematica and other similar software packages provided to perform complex computations such as an FFT, with simply one line of code:

Y = fft(X)

TensorFlow 2.0

TensorFlow, while powerful with all the great algorithms embedded needs to be augmented with additional layers of abstraction to scale…

Even though TensorFlow 2.0 is a significant leap forward in raising the abstraction level using the Keras API’s, it still does not sufficiently reduce the complexities of Feature Engineering to build accurate Machine Learning Models. It is thus very hard to use for Non-Machine Learning domain experts and other professionals, which makes one wonder if the non ML experts are simply, ‘not the target audience’ for TensorFlow 2.0.

Automatic Feature Engineering v/s TensorFlow 2.0 Linear Model on the Titanic Dataset

TensorFlow 2.0 describes a linear classifier example of the Titanic dataset. The goal is to build a linear classifier to predict if a person survived the journey on the Titanic or not, based on a set of input features . The dataset contains categorical and numerical features. To deal with this in TensorFlow2.0, there is a lot of code that needs to be written, to build a simple linear classifier model. This also requires a deep understanding of Machine Learning models, Feature Engineering and TensorFlow.

Titanic Dataset
Feature Engineering on the Titanic Dataset using TensorFlow 2.0

VERIFAI Machine Learning Platform: Automatic Feature Engineering

VerifAI’s Automatic Feature Engineering is a set of algorithms that transform the input data into a form (numerical vectors) that the Machine Learning Algorithms can understand. Our Automatic Feature Engineering hides the complexity and details of data transformation required before feeding the data into a DNN (Deep Neural Network) or other machine learning models.

For instance the categorical feature columns in the Titanic dataset such as {‘fare’ , ‘sex’, ‘n_siblings_spouses’, ‘class’ , ‘deck’ ,’ embark_town’ and ‘alone’ } are automatically encoded into numerical values a machine learning model can understand, using a feature hasher, factorizer, one hot encoding or other encoding algorithms . The model’s accuracy is dependent on how the inputs are encoded and interpreted by the machine learning algorithms, thus it is important to map, encode, transform and combine the features accurately to input into a ML model.

ML engineers spend a lot of time mapping features into usable inputs for models. Our Automatic Feature Engineering (AutoMapper) is an important step towards simplifying & democratizing ML, making it available to all.

Automatic mapping and selection of Features that are usable by a DNN and other ML models
Building a Classifier for the Titanic Dataset using VerifAI Machine Learning Platform — 4 lines of code

The VerifAI Machine Learning Platform allows developers to build Classifiers, Regressors and Reinforcement Learning Algorithms with just a few lines of code or no code at all.

VerifAI AutoMapper Produces Feature Analysis plots
Feature Importance Plot produced by the VerifAI AutoMapper

To stay informed about the VerifAI-ML platform please  type in your email and click the ‘Stay Informed’ 

59 Replies to “TensorFlow 2.0 — Feature Engineering Complexity continues”

  1. Hello Admin,

    YOU NEED QUALITY VISITORS for your: verifai.ai

    My name is Marvin Bohr, and I’m a Web Traffic Specialist. I can get:
    – visitors from search engines
    – visitors from social media
    – visitors from any country you want
    – very low bounce rate & long visit duration

    CLAIM YOUR 24 HOURS FREE TEST => https://bit.ly/3gqLEoE

    Do not forget to read Review to convince you, is already being tested by many people who have trusted it !!

    TensorFlow 2.0 — Feature Engineering Complexity continues – Customized Machine Learning Platform for Design & Verification

  2. Its such as you read my thoughts! You seem to grasp so much approximately
    this, such as you wrote the guide in it or something.
    I think that you simply could do with a few % to
    force the message house a bit, but other than that, this is great blog.
    A great read. I’ll definitely be back.

  3. I’m impressed, I have to admit. Rarely do I come across a blog that’s both equally educative
    and engaging, and let me tell you, you have hit the nail on the head.
    The problem is something which too few people are speaking intelligently about.
    Now i’m very happy I found this in my search for something
    relating to this.

  4. Very quickly this web page will be famous among all blogging and site-building people, due to it’s fastidious articles

  5. Nice post. I was checking constantly this blog and I’m impressed!
    Very useful info specifically the last part 🙂 I care for such
    info much. I was seeking this certain info for
    a long time. Thank you and best of luck.

  6. You Want $5000 Or More Each Month Working With Local Businesses ?

    Google Local Raider is a complete Google Guarantee business-in-a-box.
    Everything you need to start earning passive monthly commission check is provided in a done-for-you format including a detailed,
    no-fluff guide that walks through the entire process step by step.

    MORE INFO HERE=> https://zeep.ly/Lqic4

  7. I was suggested this blog by means of my cousin. I am now not certain whether or not this post is written via him as nobody else recognize such specified about my problem.
    You’re incredible! Thanks!

  8. We’re a group of volunteers and starting a new scheme in our community.

    Your web site provided us with valuable info to work on.
    You’ve done an impressive job and our entire community will
    be grateful to you.

  9. Pretty nice post. I just stumbled upon your blog and wanted to say that I’ve really enjoyed
    browsing your blog posts. After all I will be subscribing to your feed and I
    hope you write again soon!

  10. Have you ever considered publishing an ebook or guest
    authoring on other blogs? I have a blog centered on the
    same topics you discuss and would love to have you share some stories/information.
    I know my audience would value your work. If you are even remotely interested, feel free to send me an e-mail.

  11. Woah! I’m really digging the template/theme of this
    site. It’s simple, yet effective. A lot of times it’s very hard
    to get that “perfect balance” between user friendliness and appearance.
    I must say you’ve done a amazing job with this. Additionally, the blog
    loads very fast for me on Firefox. Excellent Blog!

  12. Simply desire to say your article is as surprising. The clarity for your put up is
    just nice and that i could suppose you’re a professional in this subject.
    Fine with your permission allow me to seize your feed to stay updated with approaching
    post. Thank you one million and please carry on the enjoyable work.

  13. Good post. I learn something new and challenging on sites I stumbleupon every day.
    It’s always exciting to read articles from other authors and practice a little something from their web sites.

  14. Hello would you mind sharing which blog platform you’re working with?
    I’m planning to start my own blog in the near
    future but I’m having a difficult time selecting between BlogEngine/Wordpress/B2evolution and Drupal.
    The reason I ask is because your design and style seems different then most blogs and
    I’m looking for something unique. P.S My
    apologies for getting off-topic but I had to ask!

  15. Знаете ли вы?
    Первый футбольный трофей после начала пандемии коронавируса был разыгран в Таджикистане.
    Англичане купили заказанную португальцами рукопись голландца и бельгийца с изображениями монархов десяти королевств.
    В Чехословакии и СССР был свой «поцелуй победы».
    Видеоигру с простейшей графикой называли и шедевром, и троллингом.
    «Бикини» для лица помогает китаянкам уберечь кожу от медуз и загара.


  16. YOU NEED QUALITY VISITORS for your: verifai.ai

    My name is Dwain Howie, and I’m a Web Traffic Specialist. I can get:
    – visitors from search engines
    – visitors from social media
    – visitors from any country you want
    – very low bounce rate & long visit duration

    CLAIM YOUR 24 HOURS FREE TEST => https://bit.ly/3gqLEoE

  17. The best SEO & Most Powerful link building software for your business.

    I just checked out your website verifai.ai and wanted to find out if you need help for SEO Link Building ?

    If you aren’t using SEO Software then you will know the amount of work load involved in creating accounts, confirming emails and submitting your contents to thousands of websites.

    With THIS SOFTWARE the link submission process will be the easiest task and completely automated, you will be able to build unlimited number of links and increase traffic to your websites which will lead to a higher number of customers and much more sales for you.

    IF YOU ARE INTERESTED, We offer you 7 days free trial => https://bit.ly/3ebnYTI

  18. I just want to say I’m new to blogs and honestly loved you’re web site. Almost certainly I’m planning to bookmark your blog . You really come with good stories. Thanks a bunch for sharing with us your web site.

  19. Thanks for every other excellent post. The place else may just anyone get that kind of info in such an ideal manner of writing? I’ve a presentation subsequent week, and I am at the look for such information.

  20. Intimately, the post is in reality the greatest on this worthy topic. I fit in with your conclusions and will thirstily look forward to your forthcoming updates. Saying thanks will not simply be sufficient, for the awesome lucidity in your writing. I will right away grab your rss feed to stay privy of any updates. Authentic work and much success in your business endeavors!

  21. I really like your blog.. very nice colors & theme. Did you design this website yourself or did you hire someone to do it for you? Plz answer back as I’m looking to create my own blog and would like to know where u got this from. cheers

  22. I’m really enjoying the design and layout of your website. It’s a very easy on the eyes which makes it much more pleasant for me to come here and visit more often. Did you hire out a designer to create your theme? Excellent work!

Leave a Reply

Your email address will not be published.