Access HTML tree from an appModule

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Access HTML tree from an appModule

mbocamazo
Hi NVDA developers list,

I'm trying to develop an appModule to facilitate reporting of accessibility issues, and I have a few questions.  Any help would be appreciated.

Is there an easy way to access the HTML hierarchy through an appModule for a web browser - either Chrome or Firefox?  I have the focus and nav objects, but they don't see to replicate the hierarchy exactly, or even sufficiently to uniquely identify elements on the page.  My goal is to have a problematic page element selected by the user be uniquely identified.  On the OFTC NVDA chat, it was suggested to look at the browser accessibility tree.  What is the object name for this tree?  I don't think I've come across it in the documentation.

My second question is less important.  It would be nice if a user could type or enter comments about the focused object into a text box after pressing a key combination.  Are there any built in text entry dialog boxes within NVDA?  Or would something have to be done with the wx python module?

Thanks again for any help or suggestions on these issues.
Mike 

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Nvda-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/nvda-devel
Reply | Threaded
Open this post in threaded view
|

Re: Access HTML tree from an appModule

Lubos Pintes
I would use an extension like Firebug for firefox for this.


Dňa 3. 12. 2016 o 6:10 Mike Bocamazo napísal(a):

> Hi NVDA developers list,
>
> I'm trying to develop an appModule to facilitate reporting of
> accessibility issues, and I have a few questions.  Any help would be
> appreciated.
>
> Is there an easy way to access the HTML hierarchy through an appModule
> for a web browser - either Chrome or Firefox?  I have the focus and
> nav objects, but they don't see to replicate the hierarchy exactly, or
> even sufficiently to uniquely identify elements on the page.  My goal
> is to have a problematic page element selected by the user be uniquely
> identified.  On the OFTC NVDA chat, it was suggested to look at the
> browser accessibility tree.  What is the object name for this tree?  I
> don't think I've come across it in the documentation.
>
> My second question is less important.  It would be nice if a user
> could type or enter comments about the focused object into a text box
> after pressing a key combination.  Are there any built in text entry
> dialog boxes within NVDA?  Or would something have to be done with the
> wx python module?
>
> Thanks again for any help or suggestions on these issues.
> Mike
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
>
>
> _______________________________________________
> Nvda-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/nvda-devel


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Nvda-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/nvda-devel
Reply | Threaded
Open this post in threaded view
|

Re: Access HTML tree from an appModule

mbocamazo
Thanks for this suggestion.  I suppose my question is deeper into NVDA: how does it parse web pages for navigation? And is that parsing easy to expose?

Do you know if NVDA would be able to interface with Firebug?  Is there documentation for interfacing with an addon of a browser from NVDA?  Firebug seems like it would be good for a developer, but maybe not for the average user.

Thanks,
Mike


On Sat, Dec 3, 2016 at 3:40 AM, Lubos Pintes <[hidden email]> wrote:
I would use an extension like Firebug for firefox for this.


Dňa 3. 12. 2016 o 6:10 Mike Bocamazo napísal(a):
> Hi NVDA developers list,
>
> I'm trying to develop an appModule to facilitate reporting of
> accessibility issues, and I have a few questions.  Any help would be
> appreciated.
>
> Is there an easy way to access the HTML hierarchy through an appModule
> for a web browser - either Chrome or Firefox?  I have the focus and
> nav objects, but they don't see to replicate the hierarchy exactly, or
> even sufficiently to uniquely identify elements on the page.  My goal
> is to have a problematic page element selected by the user be uniquely
> identified.  On the OFTC NVDA chat, it was suggested to look at the
> browser accessibility tree.  What is the object name for this tree?  I
> don't think I've come across it in the documentation.
>
> My second question is less important.  It would be nice if a user
> could type or enter comments about the focused object into a text box
> after pressing a key combination.  Are there any built in text entry
> dialog boxes within NVDA?  Or would something have to be done with the
> wx python module?
>
> Thanks again for any help or suggestions on these issues.
> Mike
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
>
>
> _______________________________________________
> Nvda-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/nvda-devel


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Nvda-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/nvda-devel


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Nvda-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/nvda-devel
Reply | Threaded
Open this post in threaded view
|

Re: Access HTML tree from an appModule

derek riemer

NVDA flattens all web pages, and a lot of this happens in process so modifying it requires modifying the DLL's that are built (NVDAHelper).

There is a COM interface I think to get at HTML with firefox, unless that isn't existent anymore. NVDA purely relies on the accessibility tree firefox exposes. The inspector in firefox is now accessible as of a few months ago, so developers can use that directly. The code to generate the virtual buffer (The document users interact with) is pretty complicated, but requires associating nodes and text and allowing a method for jumping from one node to the next, I'm not even honestly totally familiar with it myself yet.

HTH,

Derek


On 12/3/2016 9:43 PM, Mike Bocamazo wrote:
Thanks for this suggestion.  I suppose my question is deeper into NVDA: how does it parse web pages for navigation? And is that parsing easy to expose?

Do you know if NVDA would be able to interface with Firebug?  Is there documentation for interfacing with an addon of a browser from NVDA?  Firebug seems like it would be good for a developer, but maybe not for the average user.

Thanks,
Mike


On Sat, Dec 3, 2016 at 3:40 AM, Lubos Pintes <[hidden email]> wrote:
I would use an extension like Firebug for firefox for this.


Dňa 3. 12. 2016 o 6:10 Mike Bocamazo napísal(a):
> Hi NVDA developers list,
>
> I'm trying to develop an appModule to facilitate reporting of
> accessibility issues, and I have a few questions.  Any help would be
> appreciated.
>
> Is there an easy way to access the HTML hierarchy through an appModule
> for a web browser - either Chrome or Firefox?  I have the focus and
> nav objects, but they don't see to replicate the hierarchy exactly, or
> even sufficiently to uniquely identify elements on the page.  My goal
> is to have a problematic page element selected by the user be uniquely
> identified.  On the OFTC NVDA chat, it was suggested to look at the
> browser accessibility tree.  What is the object name for this tree?  I
> don't think I've come across it in the documentation.
>
> My second question is less important.  It would be nice if a user
> could type or enter comments about the focused object into a text box
> after pressing a key combination.  Are there any built in text entry
> dialog boxes within NVDA?  Or would something have to be done with the
> wx python module?
>
> Thanks again for any help or suggestions on these issues.
> Mike
>
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
>
>
> _______________________________________________
> Nvda-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/nvda-devel


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Nvda-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/nvda-devel



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most 
engaging tech sites, SlashDot.org! http://sdm.link/slashdot


_______________________________________________
Nvda-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/nvda-devel

--

Derek Riemer

  • Department of computer science, third year undergraduate student.
  • Proud user of the NVDA screen reader.
  • Open source enthusiast.
  • Member of Bridge Cu
  • Avid skiier.

Websites:
Honors portfolio
Awesome little hand built weather app!

[hidden email]
Phone: (303) 906-2194


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Nvda-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/nvda-devel