Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

NodeBB

  1. Home
  2. uncategorized
  3. I'm now writing a JSON parser in Koka.

I'm now writing a JSON parser in Koka.

Scheduled Pinned Locked Moved uncategorized
31 Posts 12 Posters 4 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

    @sun The documentation explains everything in more detail. I found it easy to understand, but I also worked with Haskell before and that permanently rewires your brain

    sun@shitposter.worldS This user is from outside of this forum
    sun@shitposter.worldS This user is from outside of this forum
    sun@shitposter.world
    wrote last edited by
    #10
    @volpeon This language looks neat, thanks for mentioning it.
    1 Reply Last reply
    0
    • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

      Afterwards I'll do JSON-LD. Straight from baby mode to "oh god oh fuck, why am I doing this to myself" ​​

      mezzodrinker@social.mezzo.moeM This user is from outside of this forum
      mezzodrinker@social.mezzo.moeM This user is from outside of this forum
      mezzodrinker@social.mezzo.moe
      wrote last edited by
      #11

      @volpeon
      JavaScript Object Notation for Linked Data
      JavaScript Object Notation Low Density

      1 Reply Last reply
      0
      • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

        Long term plan is an ActivityPub server which implements my ideas to fix microblogging (see my recent posts). If nobody picks them up, I'll just do it myself. Either it turns out they're bad and it was simply a fun little experiment, or they're good and maybe this prompts other servers to follow suit

        crw@cybre.clubC This user is from outside of this forum
        crw@cybre.clubC This user is from outside of this forum
        crw@cybre.club
        wrote last edited by
        #12

        @volpeon@icy.wyvern.rip Exactly.

        crw@cybre.clubC 1 Reply Last reply
        0
        • sun@shitposter.worldS sun@shitposter.world
          @volpeon I have a CS degree and I'm ashamed I don't know what most of this means
          ? Offline
          ? Offline
          Guest
          wrote last edited by
          #13
          @sun @volpeon the only one that i'm not super clear what they mean is 'composable'

          'composable'

          https://en.wikipedia.org/wiki/Composability

          stateless & self-contained apparently, though the wikipedia article needs love so it's probably a recent-ish term

          and maybe 'ambient state'

          'ambient state' seems pretty straightforward : just a background state

          https://www.hp.com/us-en/shop/tech-takes/what-is-ambient-computing
          1 Reply Last reply
          0
          • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

            Long term plan is an ActivityPub server which implements my ideas to fix microblogging (see my recent posts). If nobody picks them up, I'll just do it myself. Either it turns out they're bad and it was simply a fun little experiment, or they're good and maybe this prompts other servers to follow suit

            ? Offline
            ? Offline
            Guest
            wrote last edited by
            #14

            @volpeon been thinking on your thoughts/blogs/posts here and really excited to see what you come up with!

            Definitely would love to try out what you cone up with

            1 Reply Last reply
            0
            • crw@cybre.clubC crw@cybre.club

              @volpeon@icy.wyvern.rip Exactly.

              crw@cybre.clubC This user is from outside of this forum
              crw@cybre.clubC This user is from outside of this forum
              crw@cybre.club
              wrote last edited by
              #15

              @volpeon@icy.wyvern.rip BTW aber Vorsicht, mit zeitgemäßen Funktionen und einer anständigen App für iOS und Android könntest Du erfolgreicher sein als Mastodon.

              1 Reply Last reply
              0
              • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                Afterwards I'll do JSON-LD. Straight from baby mode to "oh god oh fuck, why am I doing this to myself" ​​

                volpeon@icy.wyvern.ripV This user is from outside of this forum
                volpeon@icy.wyvern.ripV This user is from outside of this forum
                volpeon@icy.wyvern.rip
                wrote last edited by
                #16

                Since Koka has no network stdlib yet, I'll have to implement URI and IRI handling first ​​

                stefan@akko.lightnovel-dungeon.deS volpeon@icy.wyvern.ripV 3 Replies Last reply
                0
                • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                  Since Koka has no network stdlib yet, I'll have to implement URI and IRI handling first ​​

                  stefan@akko.lightnovel-dungeon.deS This user is from outside of this forum
                  stefan@akko.lightnovel-dungeon.deS This user is from outside of this forum
                  stefan@akko.lightnovel-dungeon.de
                  wrote last edited by
                  #17
                  @volpeon going down the next rabbit hole?
                  volpeon@icy.wyvern.ripV 1 Reply Last reply
                  0
                  • stefan@akko.lightnovel-dungeon.deS stefan@akko.lightnovel-dungeon.de
                    @volpeon going down the next rabbit hole?
                    volpeon@icy.wyvern.ripV This user is from outside of this forum
                    volpeon@icy.wyvern.ripV This user is from outside of this forum
                    volpeon@icy.wyvern.rip
                    wrote last edited by
                    #18

                    @stefan The grind never ends ​​

                    1 Reply Last reply
                    0
                    • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                      Since Koka has no network stdlib yet, I'll have to implement URI and IRI handling first ​​

                      volpeon@icy.wyvern.ripV This user is from outside of this forum
                      volpeon@icy.wyvern.ripV This user is from outside of this forum
                      volpeon@icy.wyvern.rip
                      wrote last edited by volpeon@icy.wyvern.rip
                      #19

                      Positive side effect compared to Haskell: I can unify the URI and IRI code because if there aren't any standards, I am the one making them ​:brdCool:​ In Haskell, they were in separate packages and it was kinda clunky

                      1 Reply Last reply
                      0
                      • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                        Since Koka has no network stdlib yet, I'll have to implement URI and IRI handling first ​​

                        volpeon@icy.wyvern.ripV This user is from outside of this forum
                        volpeon@icy.wyvern.ripV This user is from outside of this forum
                        volpeon@icy.wyvern.rip
                        wrote last edited by
                        #20

                        Well, guess what
                        I need to write a module for unit testing, too
                        ​​

                        legion495@mk.absturztau.beL volpeon@icy.wyvern.ripV 2 Replies Last reply
                        0
                        • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                          Well, guess what
                          I need to write a module for unit testing, too
                          ​​

                          legion495@mk.absturztau.beL This user is from outside of this forum
                          legion495@mk.absturztau.beL This user is from outside of this forum
                          legion495@mk.absturztau.be
                          wrote last edited by
                          #21

                          @volpeon@icy.wyvern.rip An absolut unit by birb

                          1 Reply Last reply
                          0
                          • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                            Well, guess what
                            I need to write a module for unit testing, too
                            ​​

                            volpeon@icy.wyvern.ripV This user is from outside of this forum
                            volpeon@icy.wyvern.ripV This user is from outside of this forum
                            volpeon@icy.wyvern.rip
                            wrote last edited by
                            #22

                            Well, guess what
                            The community stdlib has one and it's good, so they spared me the effort
                            ​​

                            volpeon@icy.wyvern.ripV 1 Reply Last reply
                            0
                            • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                              Well, guess what
                              The community stdlib has one and it's good, so they spared me the effort
                              ​​

                              volpeon@icy.wyvern.ripV This user is from outside of this forum
                              volpeon@icy.wyvern.ripV This user is from outside of this forum
                              volpeon@icy.wyvern.rip
                              wrote last edited by volpeon@icy.wyvern.rip
                              #23

                              I was about to add unit tests for the IRI parser and found a nice JSON file with lots of test cases. I have JSON parsing, so that's good. What I don't have is a nice way to decode the generic json type to a specific type presentation, like with Aeson's FromJSON. I could still get all the test cases from the JSON file without it, but the rest of the application needs to handle JSON as well and then a decoder abstraction would be really good to have. So writing a decoder module is next ​:brdFlat:​

                              edit: Never mind again. I keep missing stuff because I keep looking for Haskell-like solutions, but Koka is simply different.

                              volpeon@icy.wyvern.ripV 1 Reply Last reply
                              0
                              • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                                I was about to add unit tests for the IRI parser and found a nice JSON file with lots of test cases. I have JSON parsing, so that's good. What I don't have is a nice way to decode the generic json type to a specific type presentation, like with Aeson's FromJSON. I could still get all the test cases from the JSON file without it, but the rest of the application needs to handle JSON as well and then a decoder abstraction would be really good to have. So writing a decoder module is next ​:brdFlat:​

                                edit: Never mind again. I keep missing stuff because I keep looking for Haskell-like solutions, but Koka is simply different.

                                volpeon@icy.wyvern.ripV This user is from outside of this forum
                                volpeon@icy.wyvern.ripV This user is from outside of this forum
                                volpeon@icy.wyvern.rip
                                wrote last edited by volpeon@icy.wyvern.rip
                                #24

                                The application crashes when the JSON is too large. I bet it's because Koka's parser combinator library makes every single step backtrackable.

                                volpeon@icy.wyvern.ripV 1 Reply Last reply
                                0
                                • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                                  The application crashes when the JSON is too large. I bet it's because Koka's parser combinator library makes every single step backtrackable.

                                  volpeon@icy.wyvern.ripV This user is from outside of this forum
                                  volpeon@icy.wyvern.ripV This user is from outside of this forum
                                  volpeon@icy.wyvern.rip
                                  wrote last edited by
                                  #25

                                  It's actually not too difficult to avoid backtracking if you make the subparsers smarter. I just didn't do it because it also makes them less readable, but oh well.
                                  So right now I parse booleans like this, for instance:
                                  string("true") || string("false"), which means it tries the first parser, and on failure the second one (and therefore the consumed input must get "un-consumed").
                                  The smarter solution is to pick the right branch directly so there is no "un-consuming" necessary. Like this:

                                  val c = one-of("tf")
                                  if c == 't' then
                                    string("rue")
                                  else
                                    string("alse")

                                  volpeon@icy.wyvern.ripV 1 Reply Last reply
                                  0
                                  • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                                    It's actually not too difficult to avoid backtracking if you make the subparsers smarter. I just didn't do it because it also makes them less readable, but oh well.
                                    So right now I parse booleans like this, for instance:
                                    string("true") || string("false"), which means it tries the first parser, and on failure the second one (and therefore the consumed input must get "un-consumed").
                                    The smarter solution is to pick the right branch directly so there is no "un-consuming" necessary. Like this:

                                    val c = one-of("tf")
                                    if c == 't' then
                                      string("rue")
                                    else
                                      string("alse")

                                    volpeon@icy.wyvern.ripV This user is from outside of this forum
                                    volpeon@icy.wyvern.ripV This user is from outside of this forum
                                    volpeon@icy.wyvern.rip
                                    wrote last edited by
                                    #26

                                    I removed all backtracking and it can handle larger JSON files now, but I still need to remove a very large chunk of the tests file to avoid the crash. ​​

                                    volpeon@icy.wyvern.ripV legion495@mk.absturztau.beL 2 Replies Last reply
                                    0
                                    • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                                      I removed all backtracking and it can handle larger JSON files now, but I still need to remove a very large chunk of the tests file to avoid the crash. ​​

                                      volpeon@icy.wyvern.ripV This user is from outside of this forum
                                      volpeon@icy.wyvern.ripV This user is from outside of this forum
                                      volpeon@icy.wyvern.rip
                                      wrote last edited by
                                      #27

                                      Looks like it's a known issue with ctl effects (which parsers use): github.com/koka-lang/koka/issues/279
                                      There's one more idea I want to try, but otherwise I'll just accept it for now

                                      volpeon@icy.wyvern.ripV 1 Reply Last reply
                                      0
                                      • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                                        I removed all backtracking and it can handle larger JSON files now, but I still need to remove a very large chunk of the tests file to avoid the crash. ​​

                                        legion495@mk.absturztau.beL This user is from outside of this forum
                                        legion495@mk.absturztau.beL This user is from outside of this forum
                                        legion495@mk.absturztau.be
                                        wrote last edited by
                                        #28

                                        @volpeon@icy.wyvern.rip How large exactly? ​​

                                        1 Reply Last reply
                                        0
                                        • volpeon@icy.wyvern.ripV volpeon@icy.wyvern.rip

                                          Looks like it's a known issue with ctl effects (which parsers use): github.com/koka-lang/koka/issues/279
                                          There's one more idea I want to try, but otherwise I'll just accept it for now

                                          volpeon@icy.wyvern.ripV This user is from outside of this forum
                                          volpeon@icy.wyvern.ripV This user is from outside of this forum
                                          volpeon@icy.wyvern.rip
                                          wrote last edited by
                                          #29

                                          IRI parser works ​​
                                          Only the IRI resolution algorithm left, and then I can finally get to JSON-LD

                                          johann150@genau.qwertqwefsday.euJ volpeon@icy.wyvern.ripV 2 Replies Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          Powered by NodeBB Contributors
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups