Latest ser news

ser

New browser on the block: Flow

By www.quirksmode.org
Published On :: Tue, 21 Jan 2020 12:01:18 +0100

2020 is only three weeks old, but there has been a lot of browser news that decreases rendering engine diversity. It’s time for some good news on that front: a new rendering engine, Flow. Below I conduct an interview with Piers Wombwell, Flow’s lead developer.

This year alone, on the negative side Mozilla announced it’s laying off 70 people, most of whom appear to come from the browser side of things, while it turns out that Opera’s main cash cow is now providing loans in Kenya, India, and Nigeria, and it is looking to use 'improved credit scoring' (from browsing data?) for its business practices.

On the positive side, the Chromium-based Edge is here, and it looks good. Still, rendering engine diversity took a hit, as we knew it would ever since the announcement.

So let’s up the diversity a notch by welcoming a new rendering engine to the desktop space. British company Ekioh is working on a the Flow browser, which sports a completely new multi-threaded rendering engine that does not have any relation to WebKit, Gecko, or Blink.

The last new rendering engine to come to the desktop was KHTML back in 2000 in the form of the Konqueror browser. Later Apple adapted KHTML into WebKit. And then Google forked WebKit to become Blink. And ... well, almost everyone browses with a KHTML descendant now. Let’s not forget how it all began.

It is far too early to tell if Flow will have a similar impact, but the news was reason enough for me to conduct an interview with lead developer Piers Wombwell.

PPK: Hi Piers, could you please introduce yourself?

PW: I’m Piers Wombwell, the co-founder of Ekioh, the company behind the Flow browser. I’m also the architect of the project and one of the software engineers on it.

Why did Ekioh decide to create a new browser?

In 2006 we started developing an SVG engine for user interfaces in the set-top box market. No existing browser was full-featured, or was fast enough on the low-powered set-top box chips available at the time. User interface developers wanted HTML, but couldn’t get the performance they needed, especially in animations. SVG seemed better suited to user interfaces as there was no time spent in complex box model layout.

A user interface running on our SVG engine was much faster than any of the HTML browsers at the time and was very popular in this niche market with millions of STBs running it across most continents.

Over the next six or so years, STB chips started to move to multi-core GPUs, at the same as TV resolutions were moving to 4K. HTML was becoming fast enough on set-top boxes. On the other hand, a 4K TV has four times as many pixels as an HD TV, and a multi-core GPU doesn't make each individual core any faster. Thus, a single threaded browser won’t really see any significant speed improvements. That's why we decided to make Flow multi-threaded.

Dabbling with HTML/CSS layout seemed equally fun technically as building an SVG browser, so that’s been the main focus since. It started off being an XHTML/CSS layout engine on top of SVG, but we got carried away and over time moved to full HTML.

But, really, I suppose we did it because it would be fun to do it.

How far along is Flow? Can people download it and use it right now?

Well, it can render and interact with Gmail quite well. It’s pretty much perfect on a few sites we’ve targeted as focuses during development, but it struggles with many others. We only started implementing HTML forms in the last few months in order to log into Gmail.

It’s not yet available for download as I think we need to address the usability of it first. It currently needs a configuration file tailored to your computer, and has no toolbar. You don't want a toolbar for TV interfaces, so we never implemented one.

For which platforms is Flow currently available?

For Mac, Linux, and Android. Plus, of course, for the set-top boxes that are our main market, most of which run Linux. As to Windows, none of us run Windows so its development is untested and lags behind a bit, but I’ve just compiled a version and it seems to work.

Is Flow open source?

It’s not. There’s no current plan for that as we don’t have a large corporation backing our development.

Which JavaScript engine do you use?

We chose Spidermonkey in 2006, and as far as I recall it was because of both licensing and a documented embedding API. It was around the time that TiVo were having arguments over the GPL. The paranoia over that also ruled out use of LGPL licensed libraries for a few years.

The core browser code is abstracted away from any Spidermonkey APIs, largely so we could handle upgrades over the years - we can still handle its legacy garbage collection model quite happily.

What are your long-term goals with Flow?

The primary goal is stability, followed by getting more websites rendering perfectly in Flow. They generally fail because of either layout bugs or missing JavaScript APIs in Flow, so we have to solve those. Even for the embedded market, getting as many websites working as possible improves our confidence that a new HTML user interface will function correctly, first time.

Our roadmap is very flexible, usually because of commercial needs, but also we prioritise what’s interesting to a developer at that given time.

You said Flow is multi-threaded. Which tasks exactly are divided among the multiple threads?

HTML and CSS parsing is single-threaded, as is JavaScript (if you ignore WebWorkers). It’s the layout, primarily word wrap of text, that is done in parallel. Several caveats apply, but in general, two paragraphs can be laid out in parallel since they don’t impact each other apart from their vertical position.

We wrote some technical papers on this process.

Is the word wrap of paragraphs the computationally most expensive part of laying out an HTML page?

Yes. Each letter is a separate rectangle, plus you have word wrap rules for groups of letters. It’s also probably the hardest to achieve, so it's a good place to start. Desktop browsers haven’t touched layout, and have instead concentrated on making whole components run in separate threads.

Is Flexbox one of the caveats you mentioned?

There are multiple passes across the tree, all in parallel. We first calculate, in parallel, essentially the min-content and max-content widths of each paragraph, flexbox or table cell. Once we have those constraints, a relatively quick pass (not in parallel for that one flex box) works out the final widths of each box.

But we can handle multiple flexboxes in parallel, or one flex box and a paragraph outside the flexbox, and so on.

How integral is multi-threading to Flow and its architecture? Could you remove it? Would other browsers be able to copy Flow's multi-threading?

Multithreading can be turned off with a config setting. I suspect it’s always going to be easier to rewrite the layout code with multithreading in mind than rework existing layout algorithms - Mozilla took that approach that with Servo, rather than rework Gecko. The new layout engine could then, in theory, be combined with the rest of an existing browser.

Can you give an example of tricky problems you encountered while creating this browser?

Many sites, Gmail being a good example, were very frustrating as the JavaScript can be so large and obfuscated. It’s almost impossible to tell what they are doing, and much of the debugging was educated guesses as to what it was trying to do. Thankfully, the web platform tests help us make sure we are compatible with other browsers once we figured out the blocking bug or missing feature.

We can’t realistically pass these tests 100% as they test such a huge set of APIs - it would take us years to catch up with other browsers so we can only focus on what is used by priority websites.

And something that was much easier to implement than you thought?

The HTML parser. I first wrote an HTML parser back in 2002, and back then there was no detailed specification of how to handle badly-nested elements. We spent so much time writing test cases to figure out what desktop browsers did in each situation, and trying to behave the same. Ten years later, the detail in the WHAT-WG specification was amazing, and it was perfectly possible to write an HTML parser that is completely compatible with all other browsers.

And a feature you decided not to implement for now?

HTML forms. A TV user interface doesn’t use most, if any, of the features of HTML forms so it was a very low priority. We started adding them because they are needed for general web browsing, but they are not complete.

We haven’t yet implemented WebGL or IndexedDB because they are not used on most of the websites we’ve tried. Obviously Google Maps uses WebGL and Google Docs uses IndexedDB but both have fallbacks. Implementing more features to allow a larger number of websites to work is a priority.

What is Flow's UA string?

For the Mac version, it's the following:

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_0) EkiohFlow/5.7.4.30559 
Flow/5.7.4 (like Gecko Firefox/53.0 rv:53.0)

The strings vary depending on the device, but the "EkiohFlow" and "Flow" strings should always occur.

Why do you emulate Firefox? I assumed it'd be Chrome.

We’ve spent ages on that UA string… I could probably write a blog post about it. Essentially, I copied Chrome. Things mostly worked. Then I hit the Instagram site, which decided to use ES6 features based on the UA string. I changed it to FireFox’s, using the version of SpiderMonkey that we were using (53 in the build you have), and the site worked. Then I added more afterwards (the rc:53) to get us to the more modern Google login box.

The UA string isn’t final at all but its choice is full of compromises.

Ekioh creates browsers for set-top boxes. What is Flow’s main purpose on set-top boxes?

It is used to render the UIs created by the box’s vendors, and not for actually surfing the web. But we don’t always get to see the UIs the vendors create, so being able to render all HTML flawlessly is the goal. That way, UI developers can do as they please.

Does the average set-top box have a browser meant for surfing the web?

Sort-of, but not really. I have a 2012 Sony TV with that functionality, but it was useless then and is useless now. IR has a significant lag, and that makes TV remotes far too painful to control a TV browser with. I don’t recall any modern TV/STBs that let you have open internet, but they probably exist. I can’t imagine anyone seriously using them.

Flow also runs on TVs and embedded devices. Could you give a few examples of embedded browsers? And TV browsers?

Back before we started our SVG engine, there were many HTML 4 browser engines for the TV market, such as ANT Fresco and Galio (which I also worked on), Access’s NetFront, Oregan, Espial and Opera. For the non-TV market, we have replaced Internet Explorer Mobile on a line of Windows CE devices. These days, almost all embedded browsers are based on Blink or WebKit.

What are your main competitors in the TV and embedded browser markets?

The main competitors to Flow are Blink and WebKit. Most STB providers often do their own port of one of these browsers. WebKit can be optimised for these low-powered devices, but Flow is usually able to out perform other browsers, and in the areas it’s not as fast, we can usually optimise it.

In a strange way, we also compete with ourselves - we offer our own embedded WebKit-based browser that is more feature-complete than Flow. The same developers work on maintaining and improving that.

Thanks for this interview!

You’re welcome.

New browser on the block: Flow

Probability theory and statistical inference: empirical modelling with observational data / Aris Spanos

Numerical computations: theory and algorithms: Third International Conference, NUMTA 2019, Crotone, Italy, June 15-21, 2019, Revised selected papers. / edited by Yaroslav D. Sergeyev, Dmitri E. Kvasov

Numerical computations: third International Conference, NUMTA 2019, Crotone, Italy, June 15-21, 2019, Revised Selected Papers. / Yaroslav D. Sergeyev, Dmitri E. Kvasov (eds.)

Recent Advances in Mathematics and Technology: Proceedings of the First International Conference on Technology, Engineering, and Mathematics, Kenitra, Morocco, March 26-27, 2018 / edited by Serge Dos Santos, Mostafa Maslouhi, Kasso A. Okoudjou

Time series analysis using SAS Enterprise guide Timina Liu, Shuangzhe Liu, Lei Shi

A first journey through logic / Martin Hils, François Loeser

Company offers free hair care services for Covid fighters, journalists

Letter to BS: Privacy concerns over Aarogya Setu app deserves to be noted

Letter to BS: Pharma industry, pharmacists also deserve appreciation

PUBG Mobile India Series 2020: Prize money, date of tournament and registra...

Updated: Gauhati High Court orders Assam Govt to restore mobile Internet services

Yes, Sometimes We Can Serve Both God and Mammon

EXCLUSIVE! Check out the teaser of Akshay Kumar's Gabbar!

Christian Bale, Andy Serkis meet Bollywood

Meet Sivagami from the Baahubali Web Series

Flexible and luminescent fibers of a 1D Au(I)–thiophenolate coordination polymer and formation of gold nanoparticle-based composite materials for SERS

Controllable tuning of Fabry–Perot cavities via laser printing

Tales from the Desert Borderland Lawrence J. Taylor

Artificial intelligence: anthropogenic nature vs. social origin / Elena G. Popkova, Bruno S. Sergi, editors

Agile Enterprise Engineering: smart application of human factors: models, methods, practices, case studies / Sergey V. Zykov, Amitoj Singh

Applying the classification of finite simple groups: a user's guide / Stephen D. Smith

Die Entführung aus dem Serail / Mozart ; a co-production between Glyndebourne, François Roussillon et Associés and ZDF in collaboration with ARTE ; with the participation of NRK and Mezzo

Serenade for Haiti / producers, Owsley Brown, Anne Flatté, Christy McGill ; director, Owsley Brown

[ASAP] Direct Observation of Micelle Fragmentation via In Situ Liquid-Phase Transmission Electron Microscopy

VI. miserere seu psalmus quinquagesimus sexies, ... seu Stabat Mater ... in lucem editus & à 4. Vocibus ordinariis, 2. Violinis ac Organo obligatis, Viola, 2. Clarinis, 3. Tromponis ac Violoncello ad libitum ... Joannis Antonii Kobrich, ... opus

Sonate pour guitarre & basson ou alto très-humblement dédiée à son Altesse Serenissime Louise Eleonore Duchesse regnante de Saxe-Meinungen ; Oeuvre 13

Serenade für Flöte und Guitarre 54tes Werk

Visualization of materials using the confocal laser scanning microscopy technique

Near-infrared laser driven white light continuum generation: materials, photophysical behaviours and applications

Paul Kelly : the essays / edited by David Leser

Manipur Speakers Tribunal reserves verdict

Rabindra Jayanti observed

Webinar Series: Preaching Through Disruption

Anti-aging drugs: from basic research to clinical practice / edited by Alexander M. Vaiserman

Drug delivery approaches and nanosystems / editors, Raj K. Keservani, Anil K. Sharma, Rajesh K. Kesharwani

Oral anticoagulation therapy: cases and clinical correlation / Kathryn Kiser, editor

Cellular and molecular toxicology of nanoparticles / Quaiser Saquib, Mohammad Faisal, Abdulaziz A. Al-Khedhairy, Abdulrahman A. Alatar, editors

Drug interactions in infectious diseases: antimicrobial drug interactions / Manjunath P. Pai, Jennifer J. Kiser, Paul O. Gubbins, Keith A. Rodvold, editors

Drug interactions in infectious diseases: mechanisms and models of drug interactions / Manjunath P. Pai, Jennifer J. Kiser, Paul O. Gubbins, Keith A. Rodvold, editors

The drug development paradigm in oncology: proceedings of a workshop / Amanda Wagner Gee, Erin Balogh, Margie Patlak, and Sharyl J. Nass, rapporteurs ; National Cancer Policy Forum, Board on Health Care Services, Health and Medicine Division, the National

Nervous system drug delivery: principles and practice / edited by Russell R. Lonser, Malisa Sarntinoranont, Krystof Bankiewicz

The role of NIH in drug development innovation and its impact on patient access: proceedings of a workshop / Francis K. Amankwah, Alexandra Andrada, Sharyl J. Nass, and Theresa Wizemann, rapporteurs ; Board on Health Care Services ; Board on Health Scienc

‘Miedo de ser enfermera’: Los trabajadores de la salud están bajo ataque

Global Bat Populations Need Research and Conservation Action

Disney Conservation Fund Helps Bat Conservation International Support Wildlife and the Environment

Applied Concepts in Fractured Reservoirs

On Ignored Users Spoken Language

Who Is Directly Affected And Is Wasting Money

Who Is Responsible

Nobody Is Doing It Right

Google

How to serve Images on Web

Wildlife tourism, environmental learning and ethical encounters: ecological and conservation aspects / edited by Ismar Borges de Lima, Ronda J. Green

Vivint Expands Energy Services with Solar

Mediterranea introduces the Boardwalk Series

New Emser offering solid as a Rock

Data from Hawaii observatory helps scientists discover giant planet slingshots around its star

Potential NFL stadium moves closer to going on Inglewood ballot this summer

What the "Up" series of documentaries tells us about stages of life

Minecraft's business model is 'leave users alone' — will it be Microsoft's?

Vacuum-rated High Speed Dispersers

Mixer manufacturer offers one stop custom fabrication service

G.H. Cretors Organic Popped Corn, Single-Serve

Technology is necessary to recruit and train the next generation of home service employees

Survival reserve funds

Recession-proof service

Training Service Technicians

Terlato Wine Group taps Taraji P. Henson as strategic adviser, creative collaborator

Subscribe To Our Newsletter

Manipur Speakers Tribunal reserves verdict